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ABSTRACT 


Background 


Accurate rapid diagnostic tests for SARS-CoV-2 infection could contribute to clinical and public health strategies to manage the COVID-19 
pandemic. Point-of-care antigen and molecular tests to detect current infection could increase access to testing and early confirmation of 
cases, and expediate clinical and public health management decisions that may reduce transmission. 


Objectives 


To assess the diagnostic accuracy of point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection. We consider 
accuracy separately in symptomatic and asymptomatic population groups. 


Search methods 


Electronic searches of the Cochrane COVID-19 Study Register and the COVID-19 Living Evidence Database from the University of Bern (which 
includes daily updates from PubMed and Embase and preprints from medRxiv and bioRxiv) were undertaken on 30 Sept 2020. We checked 
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repositories of COVID-19 publications and included independent evaluations from national reference laboratories, the Foundation for 
Innovative New Diagnostics and the Diagnostics Global Health website to 16 Nov 2020. We did not apply language restrictions. 





Selection criteria 


We included studies of people with either suspected SARS-CoV-2 infection, known SARS-CoV-2 infection or known absence of infection, 
or those who were being screened for infection. We included test accuracy studies of any design that evaluated commercially produced, 
rapid antigen or molecular tests suitable for a point-of-care setting (minimal equipment, sample preparation, and biosafety requirements, 
with results within two hours of sample collection). We included all reference standards that define the presence or absence of SARS-CoV-2 
(including reverse transcription polymerase chain reaction (RT-PCR) tests and established diagnostic criteria). 


Data collection and analysis 


Studies were screened independently in duplicate with disagreements resolved by discussion with a third author. Study characteristics 
were extracted by one author and checked by a second; extraction of study results and assessments of risk of bias and applicability (made 
using the QUADAS-2 tool) were undertaken independently in duplicate. We present sensitivity and specificity with 95% confidence intervals 
(Cls) for each test and pooled data using the bivariate model separately for antigen and molecular-based tests. We tabulated results by test 
manufacturer and compliance with manufacturer instructions for use and according to symptom status. 


Main results 


Seventy-eight study cohorts were included (described in 64 study reports, including 20 pre-prints), reporting results for 24,087 samples 
(7,415 with confirmed SARS-CoV-2). Studies were mainly from Europe (n = 39) or North America (n = 20), and evaluated 16 antigen and 
five molecular assays. 


We considered risk of bias to be high in 29 (37%) studies because of participant selection; in 66 (85%) because of weaknesses in the 
reference standard for absence of infection; and in 29 (37%) for participant flow and timing. Studies of antigen tests were of a higher 
methodological quality compared to studies of molecular tests, particularly regarding the risk of bias for participant selection and the index 
test. Characteristics of participants in 35 (45%) studies differed from those in whom the test was intended to be used and the delivery of the 
index test in 39 (50%) studies differed from the way in which the test was intended to be used. Nearly all studies (97%) defined the presence 
or absence of SARS-CoV-2 based on a single RT-PCR result, and none included participants meeting case definitions for probable COVID-19. 


Antigen tests 


Forty-eight studies reported 58 evaluations of antigen tests. Estimates of sensitivity varied considerably between studies. There were 
differences between symptomatic (72.0%, 95% Cl 63.7% to 79.0%; 37 evaluations; 15530 samples, 4410 cases) and asymptomatic 
participants (58.1%, 95% Cl 40.2% to 74.1%; 12 evaluations; 1581 samples, 295 cases). Average sensitivity was higher in the first week 
after symptom onset (78.3%, 95% Cl 71.1% to 84.1%; 26 evaluations; 5769 samples, 2320 cases) than in the second week of symptoms 
(51.0%, 95% Cl 40.8% to 61.0%; 22 evaluations; 935 samples, 692 cases). Sensitivity was high in those with cycle threshold (Ct) values 
on PCR £25 (94.5%, 95% Cl 91.0% to 96.7%; 36 evaluations; 2613 cases) compared to those with Ct values >25 (40.7%, 95% Cl 31.8% to 
50.3%; 36 evaluations; 2632 cases). Sensitivity varied between brands. Using data from instructions for use (IFU) compliant evaluations in 
symptomatic participants, summary sensitivities ranged from 34.1% (95% Cl 29.7% to 38.8%; Coris Bioconcept) to 88.1% (95% Cl 84.2% to 
91.1%; SD Biosensor STANDARD Q). Average specificities were high in symptomatic and asymptomatic participants, and for most brands 
(overall summary specificity 99.6%, 95% Cl 99.0% to 99.8%). 


At 5% prevalence using data for the most sensitive assays in symptomatic people (SD Biosensor STANDARD Q and Abbott Panbio), positive 
predictive values (PPVs) of 84% to 90% mean that between 1 in 10 and 1 in 6 positive results will be a false positive, and between 1 in 4 
and 1 in 8 cases will be missed. At 0.5% prevalence applying the same tests in asymptomatic people would result in PPVs of 11% to 28% 
meaning that between 7 in 10 and 9 in 10 positive results will be false positives, and between 1 in 2 and 1 in 3 cases will be missed. 


No studies assessed the accuracy of repeated lateral flow testing or self-testing. 
Rapid molecular assays 


Thirty studies reported 33 evaluations of five different rapid molecular tests. Sensitivities varied according to test brand. Most of the data 
relate to the ID NOW and Xpert Xpress assays. Using data from evaluations following the manufacturer’s instructions for use, the average 
sensitivity of ID NOW was 73.0% (95% Cl 66.8% to 78.4%) and average specificity 99.7% (95% Cl 98.7% to 99.9%; 4 evaluations; 812 samples, 
222 cases). For Xpert Xpress, the average sensitivity was 100% (95% Cl 88.1% to 100%) and average specificity 97.2% (95% Cl 89.4% to 
99.3%; 2 evaluations; 100 samples, 29 cases). Insufficient data were available to investigate the effect of symptom status or time after 
symptom onset. 


Authors' conclusions 


Antigen tests vary in sensitivity. In people with signs and symptoms of COVID-19, sensitivities are highest in the first week of illness when 
viralloads are higher. The assays shown to meet appropriate criteria, such as WHO's priority target product profiles for COVID-19 diagnostics 
(‘acceptable’ sensitivity = 80% and specificity = 97%), can be considered as a replacement for laboratory-based RT-PCR when immediate 
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decisions about patient care must be made, or where RT-PCR cannot be delivered in a timely manner. Positive predictive values suggest 
that confirmatory testing of those with positive results may be considered in low prevalence settings. Due to the variable sensitivity of 
antigen tests, people who test negative may still be infected. 





Evidence for testing in asymptomatic cohorts was limited. Test accuracy studies cannot adequately assess the ability of antigen tests 
to differentiate those who are infectious and require isolation from those who pose no risk, as there is no reference standard for 
infectiousness. A small number of molecular tests showed high accuracy and may be suitable alternatives to RT-PCR. However, further 
evaluations of the tests in settings as they are intended to be used are required to fully establish performance in practice. 


Several important studies in asymptomatic individuals have been reported since the close of our search and will be incorporated at the 
next update of this review. Comparative studies of antigen tests in their intended use settings and according to test operator (including 
self-testing) are required. 


PLAIN LANGUAGE SUMMARY 


How accurate are rapid tests for diagnosing COVID-19? 

What are rapid point-of-care tests for COVID-19? 

Rapid point-of-care tests aim to confirm or rule out COVID-19 infection in people with or without COVID-19 symptoms. They: 
- are portable, so they can be used wherever the patient is (at the point of care); 

- are easy to perform, with a minimum amount of extra equipment or complicated preparation steps; 

- are less expensive than standard laboratory tests; 

- do not require a specialist operator or setting; and 

- provide results ‘while you wait’. 


We were interested in two types of commercially available, rapid point-of-care tests: antigen and molecular tests. Antigen tests identify 
proteins on the virus; they come in disposable plastic cassettes, similar to pregnancy tests. Rapid molecular tests detect the virus’s genetic 
material in a similar way to laboratory methods, but using smaller devices that are easy to transport or to set up outside of a specialist 
laboratory. Both test nose or throat samples. 


Why is this question important? 


People with suspected COVID-19 need to know quickly whether they are infected, so that they can self-isolate, receive treatment, and 
inform close contacts. Currently, COVID-19 infection is confirmed by a laboratory test called RT-PCR, which uses specialist equipment and 
often takes at least 24 hours to produce a result. 


Rapid point-of-care tests could open access to testing for many more people, with and without symptoms, potentially in locations other 
than healthcare settings. If they are accurate, faster diagnosis could allow people to take appropriate action more quickly, with the potential 
to reduce the spread of COVID-19. 


What did we want to find out? 


We wanted to know whether commercially available, rapid point-of-care antigen and molecular tests are accurate enough to diagnose 
COVID-19 infection reliably, and to find out if accuracy differs in people with and without symptoms. 


What did we do? 


We looked for studies that measured the accuracy of any commercially produced, rapid antigen or molecular point-of-care test, in people 
tested for COVID-19 using RT-PCR. People could be tested in hospital or the community. Studies could test people with or without 
symptoms. 


Tests had to use minimal equipment, be performed safely without risking infection from the sample, and have results available within two 
hours of the sample being collected. 


What we found 


We included 64 studies in the review. They investigated a total of 24,087 nose or throat samples; COVID-19 was confirmed in 7415 of these 
samples. Studies investigated 16 different antigen tests and five different molecular tests. They took place mainly in Europe and North 
America. 
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Main results 





Antigen tests 


In people with confirmed COVID-19, antigen tests correctly identified COVID-19 infection in an average of 72% of people with symptoms, 
compared to 58% of people without symptoms. Tests were most accurate when used in the first week after symptoms first developed (an 
average of 78% of confirmed cases had positive antigen tests). This is likely to be because people have the most virus in their system in 
the first days after they are infected. 


In people who did not have COVID-19, antigen tests correctly ruled out infection in 99.5% of people with symptoms and 98.9% of people 
without symptoms. 


Different brands of tests varied in accuracy. Pooled results for one test (SD Biosensor STANDARD Q) met World Health Organization (WHO) 
standards as ‘acceptable’ for confirming and ruling out COVID-19 in people with signs and symptoms of COVID-19. Two more tests met the 
WHO acceptable standards (Abbott Panbio and BIONOTE NowCheck) in at least one study. 


Using summary results for SD Biosensor STANDARD Q, if 1000 people with symptoms had the antigen test, and 50 (5%) of them really had 
COVID-19: 


- 53 people would test positive for COVID-19. Of these, 9 people (17%) would not have COVID-19 (false positive result). 
- 947 people would test negative for COVID-19. Of these, 6 people (0.6%) would actually have COVID-19 (false negative result). 


In people with no symptoms of COVID-19 the number of confirmed cases is expected to be much lower than in people with symptoms. 
Using summary results for SD Biosensor STANDARD Q in a bigger population of 10,000 people with no symptoms, where 50 (0.5%) of them 
really had COVID-19: 


- 125 people would test positive for COVID-19. Of these, 90 people (72%) would not have COVID-19 (false positive result). 
- 9,875 people would test negative for COVID-19. Of these, 15 people (0.2%) would actually have COVID-19 (false negative result). 
Molecular tests 


Although overall results for diagnosing and ruling out COVID-19 were good (95.1% of infections correctly diagnosed and 99% correctly 
ruled out), 69% of the studies used the tests in laboratories instead of at the point-of-care and few studies followed test manufacturer 
instructions. Most of the data relate to the ID NOW and Xpert Xpress tests. We noted a large difference in COVID-19 detection between the 
two tests, but we cannot be certain about whether results will remain the same in a real world setting. We could not investigate differences 
in people with or without symptoms, nor time from when symptoms first showed because the studies did not provide enough information 
about their participants. 


How reliable were the results of the studies? 


In general, studies that assessed antigen tests used more rigorous methods than those that assessed molecular tests, particularly when 
selecting participants and performing the tests. Sometimes studies did not perform the test on the people for whom it was intended and 
did not follow the manufacturers’ instructions for using the test. Sometimes the tests were not carried out at the point-of-care. Nearly all 
the studies (97%) relied on a single negative RT-PCR result as evidence of no COVID-19 infection. Results from different test brands varied, 
and few studies directly compared one test brand with another. Finally, not all studies gave enough information about their participants 
for us to judge how long they had had symptoms, or even whether or not they had symptoms. 


What does this mean? 


Some antigen tests are accurate enough to replace RT-PCR when used in people with symptoms. This would be most useful when quick 
decisions are needed about patient care, or if RT-PCR is not available. Antigen tests may be most useful to identify outbreaks, or to select 
people with symptoms for further testing with PCR, allowing self-isolation or contact tracing and reducing the burden on laboratory 
services. People who receive a negative antigen test result may still be infected. 


Several point-of-care molecular tests show very high accuracy and potential for use, but more evidence of their performance when 
evaluated in real life settings is required. 


We need more evidence on rapid testing in people without symptoms, on the accuracy of repeated testing, testing in non-healthcare 
settings such as schools (including self-testing), and direct comparisons of test brands, with testers following manufacturers’ instructions. 


How up-to-date is this review? 


This review updates our previous review and includes evidence published up to 30 September 2020. 
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SUMMARY OF FINDINGS 


Summary of findings 1. Diagnostic accuracy of point-of-care antigen and molecular-based tests for the diagnosis of SARS-CoV-2 infection 


Question 


Population 


Index test 


Target condition 


Reference stan- 
dard 


Action 


Quantity of evi- 
dence 


What is the diagnostic accuracy of rapid point-of-care antigen and molecular-based tests for the diagnosis of SARS-CoV-2 infection? 


Adults or children with suspected: 
* current SARS-CoV-2 infection 
or populations undergoing screening for SARS-CoV-2 infection, including 


* asymptomatic contacts of confirmed COVID-19 cases 
* community screening 


Any rapid antigen or molecular-based test for diagnosis of SARS-CoV-2 meeting the following criteria: 


* portable or mains-powered device 

« minimal sample preparation requirements 

« minimal biosafety requirements 

* no requirement for a temperature-controlled environment 
« test results available within 2 hours of sample collection 


Detection of current SARS-CoV-2 infection 


For COVID-19 cases: positive RT-PCR alone or clinical diagnosis of COVID-19 based on established guidelines or combinations of clinical features 


For non-COVID-19 cases: negative RT-PCR or pre-pandemic sources of samples 


False negative results mean missed cases of COVID-19 infection, with either delayed or no confirmed diagnosis and increased risk of community trans- 
mission due to false sense of security 


False positive results lead to unnecessary self-isolation or quarantine, with the potential for new infection to be acquired 


Sample type Number studies Total samples Samples from confirmed 
SARS-CoV-2 cases 

Respiratory 77 24,418 7484 

Non-respira- 1 79 29 

tory 


Limitations in the evidence 


Risk of bias 


Participants: high (29) or unclear (27) risk in 56 studies (72%) 
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(based on 78 Index test (antigen tests): high (0) or unclear (19) risk in 19 studies (40% of 48 studies) 
studies) 


Index test (molecular tests): high (3) or unclear (22) risk in 25 studies (83% of 30 studies) 
Reference standard: high (66) unclear (6) risk in 72 studies (92%) 


Flow and timing: high (29) or unclear (36) risk in 65 studies (83%) 


Concerns about Participants: high concerns in 35 studies (45%) 
applicability 
Index test (antigen tests): high concerns in 23 studies (48% of 48 studies) 


(based on 78 
studies) Index test (molecular tests): high concerns in 16 studies (53% of 30 studies) 


Reference standard: high concerns in 76 studies (97%) 


Findings: antigen tests 


Evaluations Samples (SARS-CoV-2 cases) Sensitivity (95% Cl) Specificity (95% Cl) 
(studies) 
[Range] [Range] 
Symptomatic 37 (27) 15,530 (4410) 72.0 (63.7 to 79.0) 99.5 (98.5 to 99.8) 
[0% to 100%] [8% to 100%] 
Symptomatic (up 26 (21) 2320 (2320) 78.3 (71.1 to 84.1) - 
to 7 days from 
onset of symp- [15% to 95%] 
toms)¢ 
Asymptomatic 12 (10) 1581 (295) 58.1 (40.2 to 74.1) 98.9 (93.6 to 99.8) 


[29% to 85%] [14% to 100%] 
Examples of pooled results for individual antigen tests using data for evaluations compliant with manufacturer instructions for use according to symptom status 


Tests Evaluations Samples SARS-CoV-2 Sensitivity (95% Cl) Specificity (95% Cl) 
cases 

Symptomatic participants 

Coris Bioconcept 3 780 414 34.1 (29.7 to 38.8) 100 (99.0 to 100) 


- COVID-19 Ag 
Respi-Strip 
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Abbott - Panbio 
Covid-19 Ag 


SD Biosensor 
- STANDARD Q 
COVID-19 Ag 


Asymptomatic participants 


Coris Bioconcept 
- COVID-19 Ag 
Respi-Strip 


Abbott - Panbio 
Covid-19 Ag 


SD Biosensor 
- STANDARD Q 
COVID-19 Ag 


3 


2 


1 


1094 


1947 


45 


474 


127 


252 


336 


14 


47 


13 


75.1 (57.3 to 87.1) 


88.1 (84.2 to 91.1) 


28.6 (8.4 to 58.1) 


48.9 (35.1 to 62.9) 


69.2 (38.6 to 90.9) 


99.5 (98.7 to 99.8) 


99.1 (97.8 to 99.6) 


100 (88.8 to 100) 


98.1 (96.3 to 99.1) 


99.1 (95.2 to 100) 


Symptomatic participants: average sensitivity and specificity (and 95% Cls) applied to a hypothetical cohort of 1000 patients where 50, 100 and 200 have COVID-19 


infection 
Test 


Coris Bioconcept 


Abbott - Panbio 
Covid-19 Ag 


SD Biosensor 
- STANDARD Q 
COVID-19 Ag 


Prevalence 


5% 


10% 


20% 


5% 


10% 


20% 


5% 


10% 


20% 


TP (95% Cl) 
17 (15 to 19) 
34 (30 to 39) 
68 (59 to 78) 
38 (29 to 44) 
75 (57 to 87) 
150 (115 to 174) 
44 (42 to 46) 
88 (84 to 91) 


176 (168 to 182) 


FP (95% Cl) 
0 (0 to 10) 

0 (0 to 9) 

0 (0 to 8) 

5 (2 to 12) 

5 (2 to 12) 

4 (2 to 10) 

9 (4 to 21) 

8 (4 to 20) 


7 (3 to 18) 


FN (95% Cl) 

33 (31 to 35) 

66 (61 to 70) 
132 (122 to 141) 
12 (6 to 21) 

25 (13 to 43) 

50 (26 to 85) 

6 (4 to 8) 

12 (9 to 16) 


24 (18 to 32) 


TN (95% Cl) 

950 (941 to 950) 
900 (891 to 900) 
800 (792 to 800) 
945 (938 to 948) 
896 (888 to 898) 
796 (790 to 798) 
941 (929 to 946) 
892 (880 to 896) 


793 (782 to 797) 


PPV 1-NPV 
100% 3.4% 
100% 6.8% 
100% 14.1% 
89% 1.3% 
94% 2.7% 
97% 5.9% 
84% 0.6% 
92% 1.3% 
96% 2.9% 
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Asymptomatic participants: average sensitivity and specificity (and 95% Cls) applied to a hypothetical cohort of 10,000 patients where 50, 100 and 200 have COV- 


ID-19 infection 


CorisBioconcept 0.5% 14 (4 to 29) 0 (0 to 1114) 36 (21 to 46) 9950 (8836 to 9950) 100% 0.4% 
1% 29 (8 to 58) 0 (0 to 1109) 71 (42 to 92) 9900 (8791 to 9900) 100% 0.7% 
2% 57 (17 to 116) 0 (0 to 1098) 143 (84 to 183) 9800 (8702 to 9800) 100% 14% 
Abbott - Panbio 0.5% 24 (18 to 31) 189 (90 to 368) 26 (19 to 32) 9761 (9582 to 9860) 11% 0.3% 
Covid-19 Ag 
1% 49 (35 to 63) 188 (89 to 366) 51 (37 to 65) 9712 (9534 to 9811) 21% 0.5% 
2% 98 (70 to 126) 186 (88 to 363) 102 (74 to 130) 9614 (9437 to 9712) 34% 1.0% 
SD Biosensor 0.5% 35 (19 to 45) 90 (0 to 478) 15 (5 to 31) 9860 (9472 to 9950) 28% 0.2% 
- STANDARD Q 
COVID-19 Ag 1% 69 (39 to 91) 89 (0 to 475) 31 (9 to 61) 9811 (9425 to 9900) 44% 0.3% 
2% 138 (77 to 182) 88 (0 to 470) 62 (18 to 123) 9712 (9330 to 9800) 61% 0.6% 


Aseaqny © 
aueiys0) QE 


“yneay seneg 


*SUOISIDaP PAWJOJU] 
*a2UapiAa paysnaL 


(MaIAaY) UOIDIJUI Z-AOD-SUYS JO SISOUZLIp 10} $}Sa} paseq-se}nda]}oOW pue UasI}Ue a1e-Jo-,UIOd ‘pidey 


BUBIYIOD aYL JO fJeYaq UO “py ‘sUOS 7g AayIM UYOL Aq paysijqnd smainay s1}eWAIsAS Jo aseqe}eq aUueIYIOD ‘sIOYINY aUL TZOZ © IySUAdOD 





Findings: rapid molecular tests 


Evaluations Samples SARS-CoV-2 cases Average sensitivity (95% Cl) Average specificity (95% Cl) 
(studies) 

[Range] [Range] 
29 (26) 4351 1787 95.1 (90.5 to 97.6) 98.8 (98.3 to 99.2) 


[57% to 100%] [92% to 100%] 


Pooled results for individual tests using data from compliant with manufacturer instructions for use 


Tests Evaluations Samples SARS-CoV-2 Sensitivity (95% Cl) Specificity (95% Cl) 
cases 

Abbott-IDNOW 4 812 222 73.0 (66.8 to 78.4) 99.7 (98.7 to 99.9) 

Cepheid - Xpert 2 100 29 100 (88.1 to 100) 97.2 (89.4 to 99.3) 

Xpress 

DRW - SAMBA II 1 149 33 87.9 (71.8 to 96.6) 97.4 (92.6 to 99.5) 
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DNANudgeCOVID 1 
Nudge 


Average sensitivity and specificity (and 95% Cls) applied to a hypothetical cohort of 1000 patients where 50, 100 and 200 have COVID-19 infection 


386 


71 


94.4 (86.2 to 98.4) 


100 (98.8 to 100) 
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Tests Prevalence TP (95% Cl) FP (95% Cl) FN (95% Cl) TN (95% Cl) Ppy b 1-NPVC 
ID NOW 5% 37 (33 to 39) 3 (1 to 12) 14 (11 to 17) 947 (938 to 949) 93% 1.4% 
10% 73 (67 to 78) 3 (1 to 12) 27 (22 to 33) 897 (888 to 899 96% 2.9% 
20% 146 (134 to 157) 2 (1 to 10) 54 (43 to 66) 798 (790 to 799 98% 6.3% 
Xpert Xpress 5% 50 (44 to 50) 27 (7 to 101) 0 (0 to 6) 923 (849 to 943 65% 0.0% 
10% 100 (88 to 100) 25 (6 to 95) 0 (0 to 12) 875 (805 to 894 80% 0.0% 
20% 200 (176 to 200) 22 (6 to 85) 0 (0 to 24) 778 (715 to 794 90% 0.0% 
SAMBA II 5% AA (36 to 48) 25 (5 to 70) 6 (2 to 14) 925 (880 to 945) 64% 0.6% 
10% 88 (72 to 97) 23 (5 to 67) 12 (3 to 28) 877 (833 to 896) 79% 1.4% 
20% 176 (144 to 193) 21 (4 to 59) 24 (7 to 56) 779 (741 to 796) 89% 3.0% 
COVID Nudge 5% 47 (43 to 49) 0 (0 to 11) 3 (1 to 7) 950 (939 to 950) 100% 0.3% 
10% 94 (86 to 98) 0 (0 to 11) 6 (2 to 14) 900 (889 to 900) 100% 0.6% 
20% 189 (172 to 197) 0 (0 to 10) 11 (3 to 28) 800 (790 to 800) 100% 1.4% 


1- NPV: 1 - negative predictive value (the percentage of people with negative results who are infected); Ag: antigen;Cl: confidence interval; FN: false negative; FP: false 
positive;IFU: [manufacturers'] instructions for use; PPV: positive predictive value (the percentage of people with positive results who are infected); RT-PCR: reverse tran- 
scription polymerase chain reaction; TN: true negative; TP: true positive 


aSpecificity only estimated in 8 of 26 evaluations by time after symptom onset. 
bPPV (positive predictive value) defined as the percentage of positive rapid test results that are truly positive according to the reference standard diagnosis. 
C1-NPV (negative predictive value), where NPV is defined as the percentage of negative rapid test results that are truly negative according to the reference standard diagnosis. 
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BACKGROUND 


Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) and 
the resulting COVID-19 pandemic present important diagnostic 
evaluation challenges. These range from: understanding the value 
of signs and symptoms in predicting possible infection; assessing 
whether existing biochemical and imaging tests can identify 
infection or people needing critical care; and evaluating whether in 
vitro diagnostic tests can accurately identify and rule out current 
SARS-CoV-2 infection, and identify those with past infection, with 
or without immunity. 


We are creating and maintaining a suite of living systematic 
reviews to cover the roles of tests and patient characteristics in 
the diagnosis of COVID-19. This review is the first update of a 
review summarising evidence of the accuracy of rapid antigen and 
molecular tests that are suitable for use at the point of care. In 
some scenarios the tests could potentially be used as alternatives 
to standard laboratory-based molecular assays, such as reverse 
transcription polymerase chain reaction (RT-PCR) assays, that are 
relied on for identifying current infection, in others they may be 
used where no testing is currently done. If sufficiently accurate, 
point-of-care tests have the potential to greatly expand access and 
speed of testing, In turn, if accurate, they may have greater impact 
on public health than laboratory-based molecular methods as they 
are less expensive, provide results more quickly and do not require 
the same technical expertise and laboratory capacity. These tests 
can be undertaken locally, avoiding the need for centralised testing 
facilities that rarely meet the needs of patients, caregivers, health 
workers and society as a whole, especially in low- and middle- 
income countries. As these are rapid tests, their results can be 
returned within the same clinical encounter, facilitating timely 
decisions concerning the need for isolation and contract tracing 
activities. 


Target condition being diagnosed 


COVID-19 is the disease caused by infection with the SARS-CoV-2 
virus. The key target conditions for this suite of reviews are current 
SARS-CoV-2 infection, current COVID-19 disease, and past SARS- 
CoV-2 infection. The tests included in this review concern the 
identification of current infection, as defined by reference standard 
methods of diagnosis, including molecular assays such as RT-PCR, 
or internationally recognised clinical guidelines for diagnosis of 
SARS-CoV-2. In the context of test evaluation, and throughout this 
review, we use the term 'reference standard' to denote the best 
available method (test or tests) for diagnosing the target condition, 
as opposed to other uses of the term in diagnostic virology (such as 
reference methods or reference materials). 


For current infection, the severity of the disease is of ultimate 
importance for patient outcomes. However, rapid testing does 
not establish severity of disease, and for this review we consider 
the role of point-of-care tests for detecting SARS-CoV-2 infection 
of any severity, distinguishing only between symptomatic and 
asymptomatic infection. 


COVID-19 public health interventions focus on reducing disease 
transmission, thus it is important to identify and isolate people who 
are infected before or whilst they are infectious. It is reasonably 
presumed that people with symptoms who meet national criteria 
for COVID-19 testing, or who are identified through contact tracing, 
have a high enough risk of being infectious to ask them to isolate. 


However, assessing the risk of an individual being infectious in 
asymptomatic screening is more difficult, as there is no reference 
standard test for being ‘infectious’. Using RT-PCR status as a 
reference standard (as is done for target condition of ‘infection’) 
will ensure that infectious people are not missed, but as RT- 
PCR continues to detect viral RNA days and weeks after the 
onset of infection will wrongly classify some people as infectious. 
Alternative reference standards that have been proposed for 
infectiousness include assessing the viability of the virus using viral 
culture, or using a value of the cycle threshold (Ct value) from 
RT-PCR results to group individuals above or below a particular 
value (as a proxy for viral load) as more or less likely to be 
infectious. Converting Ct values (also known as quantification cycle 
(Cq) or crossing point (Cp) values) into direct quantitative values 
of viral load (viral copies per cell) is possible but challenging, as 
the relationship between Ct values and viral load varies between 
machines and laboratories. Thus comparison at fixed Ct values is 
unlikely to be comparable across studies. Viral culture is unsuitable 
as a reference standard because it is technically complex and often 
unreliable, which leads to it being an insensitive test (the failure 
to culture virus potentially being a result of the culture technique 
and not an indicator of non-infectiousness). The suitability of 
RT-PCR is limited as the inverse relationship between viral load 
(Ct value) and risk of infection is a continuum of risk without 
there being a meaningful cut-point (with virus being cultured 
from samples with Ct values as high as 35 (Singanayagam 2020)). 
Similarly, those with low viral loads at the onset of infection will be 
missed. A preferable alternative, of tracking contacts for evidence of 
secondary infections, requires longitudinal follow-up and is better 
considered as a question about risk of transmission, which can 
be addressed using predictive modelling approaches (taking into 
account host, agent and environmental factors). This is in contrast 
to the diagnostic test accuracy paradigm which can only determine 
if individuals are infected at a single point in time. 


For these reasons, this review only focuses on the target condition 
of 'infection' for both symptomatic and asymptomatic applications 
of tests. We do report results where they are presented split by 
an RT-PCR Ct value to report on accuracy according to groups 
with higher and lower viral load, but advise caution on their 
interpretation considering the lack of standardisation of PCR Ct 
values. Given the current state of the scientific knowledge we do 
not consider it appropriate to consider these as groups which are 
defined as 'infectious' and 'not infectious’. 


RT-PCR carries a very small risk of false positive results for infection 
and a higher risk of false negative results. False positive results 
may result from failures in sampling or laboratory protocols (e.g. 
mislabelling), contamination during sampling or processing, or 
low-level reactions during PCR (Healy 2020; Mayers 2020). At times 
when SARS-CoV-2 infections have been rare, population prevalence 
surveys using RT-PCR have shown test positivity rates of 0.44% 
(95% credible interval: 0.22% to 0.76%) (August 2020; ONS 2020), 
and 0.077% (0.065%, 0.092%) (June to July 2020; Riley 2020 React-1 
study). These values can be used to place an upper bound on 
the possible false positive rate of RT-PCR of less than 0.077% (as 
the total numbers testing positive will comprise both true positive 
and false positive RT-PCR results). The World Health Organization 
(WHO) recently issued a notice of concern regarding interpretation 
of specimens at or near the limit for PCR positivity (i.e. those 
with high cycle threshold (Ct) values), citing potential difficulties in 
distinguishing the presence of the target virus from these types of 
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background ‘noise’ (WHO 2020a). False negative rates have been 
estimated by looking at individuals with symptoms who initially 
test negative, but positive on a subsequent test. These rates have 
been estimated to be as high as 20% to 30% in the first week 
of symptom onset; Arevalo-Rodriguez 2020; Yang 2020a; Zhao 
2020; Kucirka 2020). Including probable COVID-19 cases within the 
target condition, as defined by internationally recognised clinical 
guidelines for diagnosis of SARS-CoV-2 will partially mitigate these 
missed cases. 


Index test(s) 


The primary consideration for the eligibility of tests for inclusion in 
this review is that they should detect current infection and should 
have the capacity to be performed at the ‘point of care’ or in a ‘near- 
patient’ testing role. There is an ongoing debate around the specific 
use and definitions of these terms, therefore for the purposes of 
this review, we consider ‘point-of-care’ and ‘near patient’ to be 
synonymous, but for consistency and avoidance of confusion, we 
use the term ‘point-of-care’ throughout. 


We have adapted a definition of point-of-care testing, namely that 
it “refers to decentralized testing that is performed by a minimally 
trained healthcare professional near a patient and outside of 
central laboratory testing” (WHO 2018), with the additional caveat 
that test results must be available within a single clinical encounter 
(Pai 2012). Our criteria for defining a point-of-care test are therefore: 


* the equipment for running and or reading the assay must be 
portable or easily transported, although mains power may be 
required; 

« minimal sample preparation requirements, for example, single- 
step mixing, with no requirement for additional equipment or 
precise sample volume transfer unless a disposable automatic 
fill or graduated transfer device is used; 


* minimal biosafety requirements, for example, personal 
protective equipment (PPE) for sample collector and test 
operator, good ventilation and a biohazard bag for waste 
disposal; 

* no requirement for a temperature-controlled environment; and 

« test results available within two hours of sample collection. 


Tests for detection of current infection that are currently suitable 
for use at the point of care include antigen tests and molecular- 
based tests. Both types of test use the same respiratory-tract 
samples acquired by swabbing, washing or aspiration as for 
laboratory-based RT-PCR. Rapid antigen tests use lateral flow 
immunoassays, which are disposable devices, usually in the form 
of plastic cassettes akin to a pregnancy test. Viral antigen is 
captured by dedicated antibodies that are either colloidal gold- or 
fluorescent-labelled. Antigen detection is indicated by visible lines 
appearing on the test strip (colloidal gold-based immunoassays, 
or CGIA), or through fluorescence, which can be detected using 
an immunofluorescence analyser (fluorescence immunoassays 
or FIA). Molecular-based tests to detect viral ribonucleic acid 
(RNA) have historically been laboratory-based assays using RT-PCR 
technology (see Alternative test(s)). In recent years, automated, 
single-step RT-PCR methods have been developed, as well as 
other nucleic acid amplification methods, such as isothermal 
amplification, that do not require the sophisticated thermo cycling 
involved in RT-PCR (Green 2020). These technological advances 
have allowed molecular technologies to be developed that are 


suitable for use in a point-of-care context (Kozel 2017), however 
they still require small portable machines and many take longer to 
produce results than antigen tests. 


Following the emergence of COVID-19 there has been prolific 
industry activity to develop accurate tests. The Foundation for 
Innovative Diagnostics (FIND) and Johns Hopkins Centre for Health 
Security have maintained online lists of available tests for SARS- 
CoV-2 (FIND 2020). At the time of writing (5 January 2021), FIND 
listed 129 rapid antigen tests, 118 of which are described as 
"commercialised" and 92 have been identified as having regulatory 
approval. These numbers are a substantial increase on the 48 listed, 
32 commercialised and 21 with regulatory approval at the time of 
our original review (19 July 2020). A total of 142 molecular tests 
were described as automated, including both laboratory-based 
assays and assays suitable for use outside of a laboratory setting 
(i.e. near or at the point of care). Further information from FIND 
indicates that 53 of the 142 assays were categorised as point-of-care 
or near point-of-care tests, including 43 with regulatory approval. 
This classification was based on the information provided to FIND 
by the test manufacturers and does not necessarily mean that these 
tests meet the criteria for point-of-care tests that we have specified 
for this review. The numbers of tests of these types will continue to 
increase over time. 


Given the urgent need to identify the evidence base for tests that 
are available for purchase, the focus of this first update of the 
review is on tests that are commercially produced. All commercially 
produced assays are supplied with a specific product code, product 
inserts or instructions for use (IFU) sheets that document the 
intended use of the test; sample storage and preparation and 
testing procedures; who should deliver the test and in whom; and 
any restrictions around the type of samples that can be used. 


There are many proposals for serial testing with lateral flow tests 
to detect infection, rather than a single use. In this case it would be 
appropriate to evaluate the accuracy of the strategy rather than a 
single test. 


Clinical pathway 


Patients may be tested for SARS-CoV-2 when they present with 
symptoms, have had known exposure to a confirmed case, or in 
a screening context, with no known exposure to SARS-CoV-2. The 
standard approach to diagnosis of SARS-CoV-2 infection is through 
laboratory-based testing of swab samples taken from the upper 
respiratory (e.g. nasopharynx, oropharynx) or lower respiratory 
tract (e.g. bronchoalveolar lavage or sputum) with RT-PCR. RT- 
PCR is the primary method for detecting infection during the 
acute phase of the illness while the virus is still present. Both 
the WHO and the China CDC (National Health Commission of the 
People's Republic of China), have produced case definitions for 
COVID-19 that include the presence of convincing clinical evidence 
(some including positive serology tests) when RT-PCR is negative 
(Appendix 1). 


Prior test(s) 


Signs and symptoms are used in the initial diagnosis of suspected 
SARS-CoV-2 infection and to help identify those requiring tests. A 
number of key symptoms have been suggested as indicators of 
mild to moderate COVID-19, including: cough, fever greater than 
37.8 °C, headache, breathlessness, muscle pain, fatigue, and loss 
of sense of smell and taste (Struyf 2021). However, the recently 
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published review of signs and symptoms found good evidence for 
the accuracy for these symptoms alone or in combination to be 
lacking (Struyf 2021). 


Where people are asymptomatic but are being tested as part 
of screening (e.g. universal testing of students as part of a risk- 
reduction effort) or on the basis of epidemiological risk factors, 
such as exposure to someone with confirmed SARS-CoV-2 or 
following travel to more highly endemic countries, no prior tests 
will have been conducted. 


Role of index test(s) 


For most settings in which testing for acute SARS-CoV-2 infection 
in symptomatic individuals takes place, results of molecular 
laboratory-based RT-PCR tests are unlikely to be available within a 
single clinical encounter. Point-of-care tests potentially have a role 
either as a replacement for RT-PCR (if sufficiently accurate), or as a 
means of triaging and rapid management (quarantine or treatment, 
or both), with confirmatory RT-PCR testing for those with negative 
rapid test results (CDC 2020; WHO 2020b). Obtaining quick results 
within a healthcare visit will allow faster decisions about isolation 
and healthcare interventions for those with positive test results, 
and allow contact tracing to begin in a more timely manner. 
Modelling studies suggest contact tracing is most effective if it starts 
within 24 hours of case detection, with delays in testing (e.g. due 
to laboratory turnaround time for reporting PCR results) leading 
to reductions in the proportion of onward transmissions per index 
case that can be prevented by track and trace (Kretzschmar 2020). 


If sufficiently accurate, negative rapid test results in symptomatic 
patients could allow faster return to work or school, therefore 
conferring important economic and educational implications. 
Negative results also allow immediate consideration of other 
causes of symptoms, which may be time-sensitive, for example 
bacterial pneumonia or thrombo-embolism. 


For asymptomatic individuals, if accurate, rapid tests may also be 
considered for screening at-risk (exposed) populations, for example 
in hospital workers or in local outbreaks. 


Rapid tests, particularly antigen tests which can be more easily 
delivered at scale, could also be used for mass screening purposes 
as recently piloted in Slovakia and in Liverpool UK (University of 
Liverpool 2020), or used in a more targeted fashion such as single 
test application at airports or for border entry, to allow entry to 
large public gatherings, or screening students as a risk-reduction 
strategy (Ferguson 2020). Preliminary data on the rollout of such 
a policy in the UK has highlighted the many challenges in such 
an approach (Deeks 2020a; Nabavi 2021), and the requirement for 
full and proper field trial evaluations. Frequent repeated use of 
antigen tests in asymptomatic individuals with no known exposure 
to identify COVID-19 cases has also been proposed (Larremore 
2020), but field trial evaluations would be required to determine 
whether promising results from modelling studies can be borne out 
in practical settings (Crozier 2021). 


Alternative test(s) 


This review is one of seven that cover the range of tests and clinical 
characteristics being considered in the management of COVID-19 
(Deeks 2020b; McInnes 2020), five of which have already been 
published (Deeks 2020c; Salameh 2020; Stegeman 2020; Struyf 
2021), including the first iteration of this review (Dinnes 2020). Full 


details of the alternative tests and evidence of their accuracy is 
summarised in these reviews. The SARS-CoV-2-specific biomarker 
tests that might be considered as alternatives to point-of-care tests 
are considered here. 


Laboratory-based molecular tests 


RT-PCR tests for SARS-CoV-2 identify viral ribonucleic acid (RNA). 
Reagents for RT-PCR were rapidly produced once the viral RNA 
sequence was published (Corman 2020). Testing is undertaken in 
central laboratories and can be very labour-intensive, with several 
points along the path of performing a single test where errors 
may occur, although some automation of parts of the process 
is possible. The amplification process requires thermal cycling 
equipment to allow multiple temperature changes within a cycle, 
with cycles repeated up to 40 times until viral DNA is detected 
(Carter 2020). Although the amplification process for RT-PCR can be 
completed in a relatively short timeframe, the stages of extraction, 
sample processing and data management (including reporting) 
mean that test results are typically only available in 24 to 48 
hours. Where testing is undertaken in a centralised laboratory, 
transport times increase this further. The time to result for fully 
automated RT-PCR assays is shorter than for manual RT-PCR, 
however most assays still require sample preparation steps that 
make them unsuitable for use at the point of care. Other nucleic 
acid amplification methods, including loop-mediated isothermal 
amplification (LAMP), or CRISPR-based nucleic acid detection 
methods, that allow amplification at a constant temperature are 
now commercially available (Chen 2020). These methods have the 
potential to reduce the time to produce test results after extraction 
and sample processing to minutes, but the time for the whole 
process may still be significant. Laboratory-based molecular tests 
are most often applied to upper and lower respiratory samples 
although they are also being used on faecal and urine samples. 


Antibody tests 


Serology tests to measure antibodies to SARS-CoV-2 have been 
evaluated in people with active infection and in convalescent cases 
(Deeks 2020c). Antibodies are formed by the body's immune system 
in response to infections, and can be detected in whole blood, 
plasma or serum. Antibody tests are available for laboratory use 
including enzyme-linked immunosorbent assay (ELISA) methods, 
or more advanced chemiluminescence immunoassays (CLIA). 
There are also rapid lateral flow assays (LFA)s for antibody testing 
that use a minimal amount of whole blood, plasma or serum on 
a testing strip as opposed to the respiratory specimens that are 
used for rapid antigen tests; all assays for antibody detection are 
considered in Deeks 2020c. 


Rationale 


It is essential to understand the clinical accuracy of tests and clinical 
features to identify the best way they can be used in different 
settings to develop effective diagnostic and management pathways 
for SARS-CoV-2 infection and disease. The suite of Cochrane living 
systematic reviews summarises evidence on the clinical accuracy of 
different tests and diagnostic features. Estimates of accuracy from 
these reviews will help inform diagnosis, screening, isolation, and 
patient-management decisions. 
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Summary of the previous version of the review 


The first iteration of this review (Dinnes 2020), included 22 
publications reporting on a total of 18 study cohorts with 
3198 unique samples, 1775 of which had confirmed SARS-CoV-2 
infection. We identified data for eight commercial tests (four 
antigen and four molecular) and one in-house antigen test. 


We did not find any studies at low risk of bias and had concerns 
about applicability of results across all studies. We judged patient 
selection to be at high risk of bias in 50% of the studies because 
of deliberate oversampling of samples with confirmed SARS-CoV-2 
infection (sample enrichment) and unclear in 38% (7/18) because 
of poor reporting. Sixteen (89%) studies used only a single, negative 
RT-PCR to confirm the absence of SARS-CoV-2 infection, risking 
missing infection. There was a lack of information on blinding of 
index test (n = 11), and about participant exclusions from analyses 
(n = 10). We did not observe differences in methodological quality 
between antigen and molecular test evaluations. 


The eight evaluations of antigen tests reported considerable 
variation in sensitivity across studies (from 0% to 94%) with 
less variation in specificities (from 90% to 100%). The average 
sensitivity was 56.2% (95% Cl 29.5 to 79.8%) and average specificity 
was 99.5% (95% Cl 98.1% to 99.9%) (based on 943 samples, 596 
with confirmed SARS-CoV-2). Data for individual antigen tests were 
limited with no more than two studies for any test. 


We observed less variation in sensitivities across 13 evaluations of 
rapid molecular assays (range 68% to 100%) with similar variation 
in specificities (range 92% to 100%). Average sensitivity was 95.2% 
(95% Cl 86.7% to 98.3%) and specificity 98.9% (95% Cl 97.3% to 
99.5%) based on a total of 2255 samples. 


We were able to calculate pooled results for only two molecular 
tests: ID NOW (Abbott Laboratories; 5 evaluations) and Xpert Xpress 
(Cepheid Inc; 6 evaluations). Summary sensitivity for the Xpert 
Xpress assay (99.4%, 95% Cl 98.0% to 99.8%) was 22.6 (95% Cl 18.8 
to 26.3) percentage points higher than that of ID NOW (76.8%, (95% 
Cl 72.9% to 80.3%), whilst the specificity of Xpert Xpress (96.8%, 
95% Cl 90.6% to 99.0%) was marginally lower than ID NOW (99.6%, 
95% Cl 98.4% to 99.9%; a difference of -2.8 percentage points (95% 
Cl from 6.4 percentage points lower to 0.8 higher). 


Changes in the evidence base since the previous version 


There has been a considerable increase in the number of 
evaluations available of antigen tests, and a lesser rise in the 
number of evaluations of molecular tests. More studies report key 
population features such as setting, and symptom status, and there 
has been an increase in direct swab testing as would occur in 
a point-of-care setting. However, due to the nature of sampling 
and the use of direct swab testing, few comparative studies are 
available. This review considers the available evidence in relevant 
population groups and settings according to test brand and 
compliance with manufacturer IFUs. We used the WHO's priority 
target product profiles for COVID-19 diagnostics (i.e. acceptable 
performance criterion of sensitivity = 80% and specificity = 97%, or 
desirable criterion of = 80% sensitivity and = 99% specificity; WHO 
2020c) as a benchmark against which to consider test performance. 


We will update this review as often as is feasible to ensure that it 
provides current evidence about the accuracy of point-of-care tests. 


This review follows a generic protocol that covers six of the seven 
Cochrane COVID-19 diagnostic test accuracy reviews (Deeks 2020b). 
The Background and Methods sections of this review therefore 
use some text that was originally published in the protocol (Deeks 
2020b), and text that overlaps some of our other reviews (Deeks 
2020c; Struyf 2021). 


OBJECTIVES 


To assess the diagnostic accuracy of rapid point-of-care antigen and 
molecular-based tests to determine if a person presenting in the 
community or in primary or secondary care has current SARS-CoV-2 
infection, and to consider accuracy separately in symptomatic and 
asymptomatic population groups. 


We estimated accuracy overall and separately according to 
symptom status (symptomatic and asymptomatic). Although 
we might expect to see differences in accuracy for testing 
of asymptomatic individuals with an epidemiological exposure 
to SARS-CoV-2 (targeted screening) compared to testing of 
asymptomatic individuals in a population screening setting, we did 
not anticipate finding sufficient numbers of studies for each testing 
application to allow any such difference to be explored. We will 
revisit this decision in subsequent iterations of this review. 


Secondary objectives 


Where data are available, we will investigate potential sources of 
heterogeneity that may influence diagnostic accuracy (either by 
stratified analysis or meta-regression) according to test method 
and index test, participant or sample characteristics (duration of 
symptoms and viral load), study setting, study design and reference 
standard used. 


We investigated adherence to manufacturers' IFUs in sensitivity 
analyses. 


METHODS 


Criteria for considering studies for this review 
Types of studies 


We applied broad eligibility criteria to include all patient groups 
(that is, if patient population was unclear, we included the study) 
and all variations of a test. 


We included studies of all designs that produce estimates of test 
accuracy or provide data from which we can compute estimates, 
including the following. 


* Studies restricted to participants confirmed to either have (or 
to have had) the target condition (to estimate sensitivity) or 
confirmed not to have (or have had) the target condition (to 
estimate specificity). These types of studies may be excluded in 
future review updates. 

« Single-group studies, which recruit participants before disease 
status has been ascertained 

« Multi-group studies, where people with and without the target 
condition are recruited separately (often referred to as two-gate 
or diagnostic case-control studies) 


¢ Studies based on either patients or samples 
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We excluded studies from which we could not extract data to 
compute either sensitivity or specificity. 


We carefully considered the limitations of different study designs in 
the quality assessment and analyses. 


We included studies reported in published journal papers, as 
preprints, and publicly available reports from independent bodies. 


Participants 


We included studies recruiting people presenting with suspicion of 
current SARS-CoV-2 infection or those recruiting populations where 
tests were used to screen for disease (for example, contact tracing 
or community screening). 


We also included studies that recruited people known to have 
SARS-CoV-2 infection and known not to have SARS-CoV-2 infection 
(i.e. cases only or multi-group studies). 


We excluded small studies with fewer than 10 samples or 
participants. Although the size threshold of 10 is arbitrary, such 
small studies are likely to give unreliable estimates of sensitivity or 
specificity and may be biased. 


Index tests 


We included studies evaluating any rapid antigen or molecular- 
based test for diagnosis of SARS-CoV-2, if it met the criteria outlined 
in the Background, that is: 


¢ requiring minimal equipment; 
* minimal sample preparation and biosafety considerations; 
¢ results available within two hours of sample collection; and 


e should be commercially produced (with test name and 
manufacturer or distributor documented). 


All sample types (respiratory or non-respiratory) were eligible. 
Strategies based on multiple applications of atest were also eligible 
for inclusion. 


Target conditions 


The target condition was current SARS-CoV-2 infection (either 
symptomatic or asymptomatic). We also refer to SARS-CoV-2 
infection as ‘COVID-19 infection’, particularly in the Plain Language 
Summary and Summary of findings 1. 


Reference standards 


We anticipated that studies would use a range of reference 
standards to define both the presence and absence of SARS- 
CoV-2 infection. For the QUADAS-2 (Quality Assessment tool 
for Diagnostic Accuracy Studies; Whiting 2011), assessment we 
categorised each method of defining the presence of SARS-CoV-2 
according to the risk of bias (the chances that it would misclassify 
the presence or absence of infection) and whether it defined 
COVID-19 in an appropriate way that reflected cases encountered 
in practice. Likewise, we considered the risk of bias in definitions of 
the absence of SARS-CoV-2, and whether the definition captured all 
those who might be tested in practice. 


Evaluations of molecular tests generally consider agreement 
between molecular assays, for example, agreement of a new rapid 
test against a more standard RT-PCR test. For the purposes of 


this review, we considered RT-PCR to be the ‘reference standard’ 
for SARS-CoV-2 infection, and present results as ‘sensitivity’ and 
’specificity’ as opposed to percentage agreement. The result of 
further RT-PCR analysis of discrepant cells (samples with results 
disagreeing on the rapid test and the RT-PCR) were also considered 
in sensitivity analyses. As discrepant analysis involves retesting 
only a sub-sample of patients selected according to index and 
reference standard results, it can introduce bias (Hadgu 1999). 
Retesting of all samples with a second test in a composite reference 
standard would be preferable when there are concerns over the 
accuracy of the first reference test. 


Search methods for identification of studies 
Electronic searches 


We used two main sources for our electronic searches through 
30 September 2020, which were devised with the help of an 
experienced Cochrane Information Specialist with diagnostic test 
accuracy review expertise (RSp). These searches aimed to identify 
all articles related to COVID-19 and SARS-CoV-2 and were not 
restricted to those evaluating a particular type of test. Thus, the 
searches used no terms that specifically focused on an index test, 
diagnostic accuracy or study methodology. 


Cochrane COVID-19 Study Register searches 


We used the Cochrane COVID-19 Study Register 
(covid-19.cochrane.org/), for searches conducted from inception 
of the Register to 28 March 2020. At that time, the register was 
populated by searches of PubMed, as well as trials registers 
at US National Institutes of Health Ongoing Trials Register 
ClinicalTrials.gov (clinicaltrials.gov) and the WHO International 
Clinical Trials Registry Platform (apps.who.int/trialsearch). 


Search strategies were designed for maximum sensitivity, to 
retrieve all human studies on COVID-19 and with no language limits. 
See Appendix 2. 


COVID-19 Living Evidence Database from the University of Bern 


From 28 March 2020, we used the COVID-19 Living Evidence 
database from the Institute of Social and Preventive Medicine 
(ISPM) at the University of Bern (www.ispm.unibe.ch), as the 
primary source of records for the Cochrane COVID-19 diagnostic 
test accuracy reviews. This search includes PubMed, Embase, 
and preprints indexed in bioRxiv and medRxiv databases. The 
strategies as described on the ISPM website are described 
here (ispmbern.github.io/covid-19/). See Appendix 3. To ensure 
comprehensive coverage we also downloaded records from the 
‘Bern feed’ from 1 January to 28 March 2020 and de-duplicated 
them against those obtained via the Cochrane COVID-19 Study 
Register. 


Due to the increased volume of published and preprint articles, 
from 25 May 2020 onwards we used artificial intelligence text 
analysis to conduct an initial classification of documents, based 
on their title and abstract information, for relevant and irrelevant 
documents (Appendix 4). 


The decision to focus primarily on the Bern feed was because of 
the exceptionally large numbers of COVID-19 studies available only 
as preprints. We are continuing to monitor the coverage of the 
Cochrane COVID-19 Study Register and may move back to it as the 
primary source of records for subsequent review updates. 
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Other electronic sources 


Prior to 28 March 2020 (when we began using the ‘Bern feed’), we 
identified Embase records through the Centers for Disease Control 
and Prevention (CDC), Stephen B Thacker CDC Library, COVID-19 
Research Articles Downloadable Database (cdc.gov/library/ 
researchguides/2019novelcoronavirus/researcharticles.html), and 
de-duplicated them against results from the Cochrane COVID-19 
Study Register. See Appendix 5. 


We also checked our search results against two additional 
repositories of COVID-19 publications up to 30 September 2020: 


* the Evidence for Policy and Practice Information and Co- 
ordinating Centre (EPPl-Centre) 'COVID-19: Living map of the 
evidence' (eppi.ioe.ac.uk/COVID19_MAP/covid_map_v4.html); 

e the Norwegian Institute of Public Health 'NIPH systematic 
and living map on COVID-19 evidence’ (www.nornesk.no/ 
forskningskart/NIPH_diagnosisMap.html) 


Both repositories allow their contents to be filtered according to 
studies potentially relating to diagnosis, and both have agreed to 
provide us with updates of new diagnosis studies added. 


Searching other resources 


We have also contacted or accessed the websites of independent 
research groups undertaking test evaluations (for example, UK 
Public Health England (PHE), the Société Francaise Microbiologie 
(SFM), the Dutch National Institute for Public Health and 
the Environment (RIVM)) and studies co-ordinated by FIND 
(finddx.org/covid-19/sarscov2-eval) and accessed the Diagnostics 
Global Health listing of manufacturer independent evaluations of 
antigen detecting rapid diagnostic tests (Ag-RDTs) for SARS-CoV-2 
(diagnosticsglobalhealth.org). We last accessed these additional 
resources on 16 November 2020. 


We appeal to researchers to supply details of additional 
published or unpublished studies at the following email 
address, which we will consider for inclusion in future updates 
(coviddta@contacts.bham.ac.uk). 


Data collection and analysis 
Selection of studies 


A team of experienced systematic review authors from the 
University of Birmingham screened the titles and abstracts of 
all records retrieved from the literature searches following the 
application of artificial intelligence text analysis (described in 
Electronic searches). Two review authors independently screened 
studies in Covidence. A third, senior review author resolved any 
disagreements. We tagged all records selected as potentially 
eligible according to the Cochrane COVID-19 diagnostic test 
accuracy review(s) for which they might be eligible and we then 
exported them to separate Covidence reviews for each review title. 


We obtained the full texts for all studies flagged as potentially 
eligible. Two review authors independently screened the full texts 
for one of the COVID-19 biomarker reviews (molecular, antigen or 
antibody tests). We resolved any disagreements on study inclusion 
through discussion with a third review author. 


Data extraction and management 


One review author extracted the characteristics of each study, 
which a second review author checked. Items that we extracted are 
listed in Appendix 6. 


Both review authors independently performed data extraction 
of 2x2 contingency tables of the number of true positives, 
false positives, false negatives and true negatives. They resolved 
disagreements by discussion. Where possible, we separately 
extracted data according to symptom status (symptomatic, 
asymptomatic, mixed symptom status or not reported), viral load 
(high or low, according to Ct cut-offs defined within each study), 
and time post-symptom onset (week one versus week two) and 
for molecular assays, before and after re-analysis of samples in 
discrepant cells. For categorisation by symptom status, we classed 
studies reporting at least 75% of participants as symptomatic as 
‘mainly symptomatic’, we considered studies with less than 75% 
symptomatic participants to report ‘mixed’ groups along with those 
that reported recruiting both symptomatic and asymptomatic 
participants but did not provide the percentages in each group. 
We considered studies that provided no information as to the 
symptom status of included participants ‘not reported’. We also 
coded evaluations according to compliance with manufacturer 
IFUs. We based coding on three aspects of testing: 


1. sample type (use of any sample not explicitly mentioned on the 
IFU scored 'No', otherwise scored 'Yes'), 


2. provision of instructions for samples in viral transport medium 
((VTM); only scored for evaluations using samples in VTM 
and only scored 'Yes' if specific instructions provided; scored 
'Unclear' if VTM used and instructions for use of samples in VTM 
not documented in IFU); and 


3. timing between sample collection and testing (scored 'Yes' only 
if all tests were carried out within specified time period, e.g. 
immediate on-site testing, or for testing in laboratories if all tests 
reported to have been carried out within specified time period; 
scored 'Unclear' if time frame for testing was not reported 
and 'No' if any testing was carried out beyond the maximum 
stipulated timeframe). 


We encourage study authors to contact us regarding missing details 
on the included studies (coviddta@contacts.bham.ac.uk). 


Assessment of methodological quality 


Two review authors independently assessed risk of bias and 
applicability concerns using the QUADAS-2 checklist tailored to this 
review (Appendix 7; Whiting 2011). The two review authors resolved 
any disagreements by discussion. 


Ideally, studies examining the use of tests in symptomatic 
people should prospectively recruit a representative sample of 
participants presenting with signs and symptoms of COVID-19, 
either in community or primary care settings or to a hospital setting, 
and they should clearly record the time of testing after the onset 
of symptoms. Studies in asymptomatic people at risk of infection 
should document time from exposure. Studies applying tests in a 
screening setting should document eligibility criteria for screening, 
particularly if a targeted approach is used and should take care to 
record any previous confirmed or suspected SARS-CoV-2 infection 
or any relevant epidemiological exposures. Studies should perform 
tests in their intended use setting, using appropriate samples with 
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or without viral transport medium and within the time period 
following specimen collection as indicated in the IFU document. 
Tests should be performed by relevant personnel (e.g. healthcare 
workers), and should be interpreted blinded to the final diagnosis 
(presence or absence of SARS-CoV-2). The reference standard 
diagnosis should be blinded to the result of the rapid test, 
and should not incorporate the result of the rapid test. If the 
reference standard includes clinical diagnosis of COVID-19 for RT- 
PCR-negative patients, then established criteria should be used. 
Studies including samples from participants known not to have 
COVID-19 should use pre-pandemic sources or if contemporaneous 
samples then at least two RT-PCR-negative tests were required to 
confirm the absence of infection. Data should be reported for all 
study participants, including those where the result of the rapid 
test was inconclusive, or participants in whom the final diagnosis 
of COVID-19 was uncertain. Studies should report whether results 
relate to participants (one sample per participant), or samples 
(multiple samples per participant). 


Statistical analysis and data synthesis 


We analysed rapid antigen and molecular tests separately. Studies 
often referred to ‘samples’ rather than ‘patients’, especially for 
the rapid molecular tests, however for many studies we do not 
suspect that inclusion of multiple samples per study participant 
was a significant issue. For consistency of terminology throughout 
the review, we refer to results on a per-sample basis. If studies 
evaluated multiple tests in the same samples, we included them 
multiple times. We present estimates of sensitivity and specificity 
per study for each test brand using paired forest plots, and 
summarise results using average sensitivity and specificity in tables 
as appropriate. As heterogeneity is apparent in many analyses, 
these point estimates must be interpreted as the average of a 
distribution of values. 


We did not make any formal comparisons between antigen assay 
brands because of the large number of different assays and small 
study numbers for many of them. We did however carry out a formal 
comparison (based on between-study comparisons) for studies 
using two brands of molecular tests (ID NOW (Abbott Laboratories) 
and Xpert Xpress (Cepheid Inc)). 


We estimated summary sensitivities and specificities with 95% 
confidence intervals (Cl) using the bivariate model (Reitsma 
2005), via the meqrlogit command of Stata/SE 16.0. When few 
studies were available, we simplified models by first assuming 
no correlation between sensitivity and specificity estimates and 
secondly by setting near-zero variance estimates of the random 
effects to zero (Takwoingi 2017). In cases where there was only one 
study per test, we reported individual sensitivities and specificities 
with 95% Cl constructed using the binomial exact method. 


Where studies presented only estimates of sensitivity or of 
specificity, we fitted univariate, random-effects, logistic regression 
models. In a number of instances where there was 100% sensitivity 
or specificity for all evaluations, we computed estimates and 95% 
Cls by summing the counts of TP, FP, FN and TN across 2x2 tables. 
These analyses are clearly marked in the tables. We present all 
estimates with 95% confidence intervals. 


Investigations of heterogeneity 


We examined heterogeneity between studies by visually inspecting 
the forest plots of sensitivity and specificity. Where adequate 


data were available, we investigated heterogeneity related to 
symptom status, time post-symptom onset, viral load, test brand, 
and test method by including indicator variables in the random- 
effects logistic regression models. Absolute differences between 
the sensitivity or specificity and the P values were reported from 
the model. In instances where only one study was available per test 
or when tests were being directly compared following summing of 
counts of the 2x2 tables, we performed test comparison using the 
two-sample test of proportions. Few studies reported specificity 
estimates by time after symptom onset, therefore for this variable 
and for analyses by viral load, we considered only effects on 
sensitivity. 


Sensitivity analyses 


We performed four sensitivity analyses. 


1. We estimated summary sensitivities and specificities according 
to test brand and symptom status using only studies that were 
compliant to the IFU. 


2. We estimated sensitivity with and without studies that only 
evaluated samples with RT-PCR-confirmed SARS-CoV-2 (and 
thus did not estimate specificity). 

3. We performed the same analysis for specificity in studies that 
only evaluated RT-PCR-negative control samples. 


4. We made comparisons between analyses using the primary 
reference standard and analyses using results adjusted after 
retesting of samples with discrepant results with a second RT- 
PCR test (discrepant analysis). 


Assessment of reporting bias 


We made no formal assessment of reporting bias but have 
indicated where we were aware that study results were available 
but unpublished. 


Summary of findings 


We summarised key findings in a 'Summary of findings' table 
indicating the strength of evidence for each test and findings, and 
highlighted important gaps in the evidence. 


Updating 


We are aware of additional studies published since the electronic 
searches were conducted on 30 September 2020 and plan to update 
this review. We have already conducted the next search to 1 January 
2021. 


RESULTS 


Results of the search 


We screened 34,742 unique records (published or preprints) for 
inclusion in the complete suite of reviews to assist in the diagnosis 
of COVID-19 (Deeks 2020b; McInnes 2020). Of 1749 records selected 
for further assessment for inclusion in any of the four molecular, 
antigen or antibody test reviews, we identified 199 full-text reports 
requiring assessment for inclusion in this review; 90 for the first 
iteration of the review and 109 for this review update. See Figure 
1 for the PRISMA flow diagram of search and eligibility results 
(McInnes 2018; Moher 2009). 
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Figure 1. Study flow diagram 


19,092 unique 15,650 unique 
records records 
screened for screened for 
first review review update 


iteration 





32,993 records excluded at 


title & abstract screening 





34,742 records screened 


1749 records selected for 

full-text assessment for one 1550 records considered 
or more COVID-19 for inclusion in other 
biomarker diagnostic test COVID-19 biomarker 
accuracy reviews (808 for diagnostic test accuracy 
first review iteration + 941 reviews 

for review update) 





135 records excluded, with the 
following reasons for exclusion: 


85 ineligible index test 
26 ineligible study design 


5 accuracy data cannot be extracted 


5 ineligible reference standard 


4 inadequate sample size 
6 ineligible population 
2 insufficient details in study report 


199 records selected for ' , 
fill tex aesecement tor 1 report superseded by published version 


point-of-care tests 1 ineligible target condition 


64 study reports included 
{reporting data for 78 study 
cohorts) 





Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 17 
Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 
Collaboration. 


Trusted evidence. 
Informed decisions. 
Better health. 


+ Cochrane 
tw Library 


Cochrane Database of Systematic Reviews 





We included 64 reports in this review, and we excluded 135 
publications that did not meet our inclusion criteria. Exclusions 
were mainly based on index test (n = 85) or ineligible study designs 
(n = 26), for example, designs that did not allow estimation of 
test accuracy. The reasons for exclusion of all 135 publications 
are provided in Characteristics of excluded studies. Appendix 8 
provides a list of studies evaluating eligible tests but excluded for 
other reasons (n = 5), and studies evaluating technologies not yet 
suitable for use at the point of care (n = 41). 


Of the 64 study reports, 18 were available only as preprints, 38 were 
published papers and eight were publicly available reports either 
from independent reference laboratories (one from Public Health 
England and two identified via the SMF) or were independent 
evaluations co-ordinated by FIND (n=5). 


We contacted the authors of 10 study reports for further 
information (Blairon 2020; Courtellemont 2020; Diao 2020; Gibani 
2020; Gremmels 2020(a); Linares 2020; Nash 2020; Porte 2020a; 
Schildgen 2020 [A]; Weitzel 2020 [A]), and received replies and the 
requested information with one exception (Linares 2020). We also 
contacted the evaluation teams at FIND and Public Health England 
and received additional information about study methods from 
FIND and some additional data from Public Health England. 


The 64 included study reports relate to 78 separate studies. Please 
note when naming studies, we use the letters [A], [B], [C] etc. in 
square brackets to indicate data on different tests evaluated in 
the same study and (a), (b), (c) to indicate data from different 
participant cohorts from the same study report. For example, 
the five included reports from FIND correspond to eight ‘studies’ 
because three reports separately provided data from more than 
one evaluation centre. 


Of the 78 studies, 77 reported data for respiratory samples and 
one (Szymczak 2020), reported data for faecal samples. The main 
results, Tables and Figures focus on the respiratory samples, with 
Szymczak 2020 reported separately. 


Description of included studies 


The 77 studies using respiratory samples included a total of 24,418 
unique samples, with 7484 samples with RT-PCR-confirmed SARS- 
CoV-2 (some samples were analysed by more than one index test). 
Forty-eight studies evaluated antigen tests (Albert 2020; Alemany 
2020; Billaud 2020; Blairon 2020; Cerutti 2020; Courtellemont 2020; 
Diao 2020; Fenollar 2020(a); Fenollar 2020(b); FIND 2020a; FIND 
2020b; FIND 2020c (BR); FIND 2020c (CH); FIND 2020d (BR); FIND 
2020d (DE); FIND 2020e (BR); FIND 2020e (DE); Fourati 2020 [A]; 
Gremmels 2020(a); Gremmels 2020(b); Gupta 2020; Kruger 2020(a); 
Kruger 2020(b); Kruger 2020(c); Lambert-Niclot 2020; Linares 2020; 
Liotti 2020; Mak 2020; Mertens 2020; Nagura-Ikeda 2020; Nash 
2020; PHE 2020(a); PHE 2020(b); PHE 2020(c) [non-HCW tested]; 
PHE 2020(d) [HCW tested]; PHE 2020(d) [Lab tested]; PHE 2020(e); 
Porte 2020a; Porte 2020b [A]; Schildgen 2020 [A]; Scohy 2020; 
Shrestha 2020; Takeda 2020; Van der Moeren 2020(a); Van der 
Moeren 2020(b); Veyrenche 2020; Weitzel 2020 [A]; Young 2020) 
and 29 studies evaluated molecular tests (Assennato 2020; Broder 
2020; Chen 2020a; Collier 2020; Cradic 2020(a); Cradic 2020(b); Dust 
2020; Ghofrani 2020; Gibani 2020; Goldenberger 2020; Harrington 
2020; Hogan 2020; Hou 2020; Jin 2020; Jokela 2020; Lephart 
2020 [A]; Lieberman 2020; Loeffelholz 2020; Mitchell 2020; Moore 
2020; Moran 2020; Rhoads 2020; Smithgall 2020 [A]; SoRelle 2020; 


Stevens 2020; Thwe 2020; Wolters 2020; Wong 2020; Zhen 2020 [A]). 
Summary study characteristics are presented in Table 1 with further 
details of study design and index test details in Appendix 9 and 
Appendix 10 for antigen assays and Appendix 11 and Appendix 12 
for molecular assays. Full details are provided in the Characteristics 
of included studies table. 


The median sample size of the included studies is 182 (interquartile 
range (IQR) 104 to 400) and median number of SARS-CoV-2 
confirmed samples included is 63 (IQR 38 to 119). Sample sizes 
for antigen test evaluations were larger than those for molecular 
test evaluations (median 291.5 (IQR 155 to 502.5) compared to 104 
(IQR 75 to 172)). Half of the studies (39/77, 51%) were conducted 
in Europe, 20 in North America, seven in South America, seven in 
Asia, one study included samples from more than one country and 
in one, the country of sample origin was unclear. 


Participant characteristics 
Antigen tests 


Over half of the antigen test studies included samples from 
participants presenting in the community for COVID-19 testing at: 
community test centres (22/48, 46%); emergency departments (3, 
6%); or as part of contact tracing or outbreak investigations (4, 
8%) (Table 1). Eleven antigen test studies (23%) selected samples 
from those submitted to laboratories for routine RT-PCR testing 
with limited detail of the participants providing the samples 
(‘laboratory-based’ studies), or included multiple (8%) or unclear 
(2%) settings. Over half of antigen test studies were conducted 
in symptomatic (16, 33%) or mainly symptomatic (11, 23%) 
populations, with only three (6%) exclusively in asymptomatic 
populations (two in asymptomatic contacts of confirmed cases 
(Fenollar 2020(b); Shrestha 2020), and one involved staff screening, 
all of whom were RT-PCR-negative (PHE 2020(e)). The remaining 
antigen studies included samples from populations with mixed 
symptom status (8, 17%) or provided no information regarding 
symptom status (10, 21%). Of the 10 that provided no information, 
seven were laboratory-based studies providing no details of the 
settings from which the tested samples had been obtained, one 
included samples from a COVID-19 test centre, one was an outbreak 
investigation and in one the study setting could not be derived. 
There were no studies evaluating strategies of multiple tests. 


A total of 13 studies provided accuracy data for people with 
no symptoms at the time of testing (3 studies exclusively in 
asymptomatic populations, and 10 studies providing subgroup 
data for people with no reported symptoms); one study provided 
only specificity data. Of the 12 datasets reporting both sensitivity 
and specificity, one (Alemany 2020), purportedly described 
preventive screening of the general population (although the 
reported prevalence of 24% is very high for such a scenario), one 
(Cerutti 2020), described targeted traveller screening, four (Billaud 
2020; Fenollar 2020(b); Gupta 2020; Shrestha 2020), tested contacts 
of confirmed cases (one as part of an outbreak investigation) 
and the remaining six datasets were subgroups of samples from 
people presenting for routine testing. We identified one additional 
asymptomatic dataset in a report of several substudies but we did 
not include it as participants underwent antigen testing up to five 
days after a positive PCR test and it was not possible to determine 
the time point at which symptom status was recorded; it was also 
not possible to determine which 'substudy’ the data related to (PHE 
2020(d) [HCW tested]; PHE 2020(d) [Lab tested]). 
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Thirty-one of the 48 studies evaluating antigen tests reported 
results for SARS-CoV-2-confirmed samples above and below a Ct 
value from the reference standard RT-PCR. The median proportion 
of participants with 'high' viral load was 52% (IQR 35% to 60%). 
The most commonly used threshold was 24 or 25 Ct or less (n 
= 29 studies (or 36/58 test evaluations); 11 studies (15/58 test 
evaluations) reported results with at a threshold of between 31 
and 33 Ct or less ; and 13 studies (13 evaluations) reported other 
thresholds including less than: 28 Ct (n = 3), 30 Ct (n =5), 31 Ct (n= 
3), or 35 Ct (n =2) 


Molecular tests 


In contrast, studies evaluating molecular tests were mainly 
laboratory-based (20, 69%), with three (10%) including samples 
from participants presenting to emergency department or urgent 
care settings, two in hospital inpatients (7%), and four (14%) 
including samples from participants presenting in multiple 
settings. Twelve of the 29 studies (41%) reported included only 
samples from symptomatic patients, four reported mixed symptom 
status (10%) and 14 (48%) provided no information regarding 
symptom status. Of the 14 that provided no information, one was 
based in a hospital Accident and Emergency department, and the 
remaining 13 were laboratory-based studies, only three of which 
gave any details of the settings from which the tested samples had 
been obtained (three reported inclusion of samples from either 
inpatients and outpatients (n = 1), inpatients and ambulatory 
patients (n= 1) orinpatients and emergency department patients (n 
= 1) but did not provide the number of samples from each source). 
There were no studies evaluating strategies of multiple tests. 


Five studies evaluating molecular assays, reported proportions 
with high viral load ranging from 33% to 80%, median 46%. All five 
studies reported results above and below a Ct value of 30. 


Study design and reference standards 


Table 1 shows a similar distribution of study designs between 
those evaluating antigen and molecular tests. Overall, 60% of 
studies (n = 46) used a ‘single group’ design to estimate both 
sensitivity and specificity and 22% (n = 17) used a ‘two group’ 
design with separate selection of RT-PCR-positive and RT-PCR- 
negative samples. In four studies (5%), the design could not be fully 
determined but probably deliberate separate sampling of RT-PCR- 
positive and RT-PCR-negative samples had been used. 


Nine studies included only samples with confirmed SARS-CoV-2, 
thus only allowing estimation of sensitivity (six antigen and three 
molecular assay studies), and one study included only SARS-CoV-2- 
negative samples allowing estimation of specificity only. All studies 
defined the presence or absence of SARS-CoV-2 infection based 
on RT-PCR. Of the 68 studies that included SARS-CoV-2-negative 
samples, 63 (93%) required a single, negative PCR to confirm 
absence of infection and two (3%) required two negative PCR 
results. The remaining three studies used pre-pandemic samples (n 
= 2) or contemporaneous samples with other respiratory infections. 


Thirty-three studies (43%), obtained paired swabs for index and 
reference standard, 39 (51%) used the same swab for point-of-care 
and RT-PCR (18 antigen and 21 molecular studies) and five studies 
used a mix of paired and same swabs (n = 1) or it was not possible 
to determine this information from the study report. 


Index tests 


Fifteen studies evaluated only one test, seven compared two or 
more tests in the same participants (four with two tests each, one 
with three tests and one each with four or five tests). In total the 
77 studies that used respiratory samples reported on a total of 
90 test evaluations. Appendix 13 provides details extracted from 
the manufacturer’s instructions for use documents for all included 
tests. 


Antigen tests 


Forty-eight studies reported 58 evaluations of antigen tests; 41 
of CGIAs, nine FIA, two alternative type of LFA using alkaline 
phosphatase-labelled antibodies, and six where assay type could 
not be determined. Studies evaluated 16 different commercially 
produced assays, as documented, with full assay identification 
details, in Appendix 13. One study reported the development of the 
Shenzhen Bioeasy assay (Diao 2020), but it is not clear whether the 
commercially available assay is identical to the one reported in the 
study or whether it has undergone further refinement. One study 
reported evaluating a Roche SARS-CoV-2 assay, which appears to 
be the SD Biosensor STANDARD Q (Schildgen 2020 [A]). Only 12 
studies provided product codes for the tests evaluated (FIND 2020a; 
FIND 2020b; FIND 2020c (BR); FIND 2020c (CH); FIND 2020d (BR); 
FIND 2020d (DE); FIND 2020e (BR); FIND 2020e (DE); Gremmels 
2020(a); Gremmels 2020(b); Porte 2020a; Weitzel 2020 [A]). The 
study reports or manufacturer IFUs for 11 assays reported targeting 
the nucleocapsid protein; this information was not reported for 
the Beijing Savant, Bionote, Biosynex, Liming Bio-Products, or 
RapiGEN Inc assays (Appendix 13). We were unable to identify 
any information for Beijing Savant, E25Bio or Liming Bio-Products 
assays online. 


Multiple combinations of sample types and use of direct swab 
testing or swabs in viral transport medium or saline were 
reported across the studies (Table 1). Forty-one of 58 evaluations 
used nasopharyngeal (n = 30), oropharyngeal (n = 1) or nasal 
(n = 2) samples (type of nasal sample was not reported), 
or combinations of nasopharyngeal, nasal or oropharyngeal 
samples (n = 8; nasopharyngeal or nasal mid-turbinate in one, 
nasopharyngeal or combined naso- and oropharyngeal in two, 
naso- or oropharyngeal in two, and naso- or oropharyngeal or 
combined naso- and oropharyngeal samples in three. Thirteen 
evaluations used combined naso- and oropharyngeal samples for 
all participants, one used saliva samples and three evaluations 
(from one study) used bronchoalveolar lavage or throat wash 
samples. Of the six studies using nasal samples either alone (n = 
2) or for at least some participants (n = 4), one reported that these 
were nares swabs, and the remaining five did not specify the type 
of nasal sample. Almost half of studies used direct swab testing (n= 
28, 48%), 22 (38%) tested samples in viral transport medium, saline 
or other medium, and in 8 (14%) this information was not provided. 


IFUs for five assays explicitly recommend against using any 
transport medium for swab testing (assays from Becton Dickinson, 
Bionote, Quidel and SD Biosensor; Appendix 13), one (Coris 
BioConcept) states that viral transport medium may be used, and 
the other nine do not mention use of transport medium, although 
two of the nine (from AAZ and Biosynex) imply that viral transport 
medium should not be used (using statements such as "use within 
one hour, stored in clean unused plastic tube"). We considered 29 
of 58 antigen evaluations (50%) to be compliant with manufacturer 
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IFUs in terms of sample type, use of viral transport medium and 
time interval between collection and testing. Sixteen evaluations 
were not compliant with IFUs; nine used viral transport medium, 
four used freezing, four tested samples not listed on the IFUs, and 
in two testing was not always conducted within the one-hour time 
period specified in the IFU. For the remaining 13 evaluations either 
no IFU was available (n = 4), viral transport medium or saline was 
used but the IFU did not specifically address whether viral transport 
medium was recommended or not (n= 7), or insufficient detail was 
provided in the study. 


Samples were collected by healthcare workers in 15 (26%) 
evaluations, by trained non-healthcare workers, such as firefighters 
or Ministry of Health employees in three (5%) evaluations, self- 
collected in six (10%) and the collection was not described 
in 34 evaluations (59%). Sample testing was conducted ‘on- 
site’ immediately or within one hour of collection in 21 (36%) 
evaluations by the same healthcare workers (n = 13), trained 
non-healthcare workers (n = 3) who collected the samples, or 
this information was not provided (n = 5). In the remaining 27 
evaluations (47%), testing was conducted by laboratory staff (n = 
12) or was inferred to be by laboratory staff (n = 15). For the latter 
group, the time interval between sample collection and testing was 
on receipt at the laboratory, some reporting delays of up to six 
hours. 


Molecular tests 


Twenty-nine studies reported 32 evaluations of five different 
commercially available rapid molecular tests: 13 evaluating ID NOW 
(Abbott Laboratories), 15 evaluating Xpert Xpress (Cepheid Inc), 
two of SAMBA II (Diagnostics for the Real World), and one evaluation 
each of Accula (Mesa Biotech Inc.) and COVID Nudge (DNANudge). 
None of the studies reported product codes for the tests evaluated. 
One study of Xpert Xpress used the 'research use only' (RUO) 
version of the test but reported that the RUO version contains the 
same reagents as the 'emergency use authorisation’ (EUA) version. 
The RUO test allows the user to view the amplification curves forthe 
RdRp gene as well as for the E-gene and N2 targets whereas the EUA 
version restricts the amplification curves to E and N2 only. ID NOW 
and SAMBA-II use isothermal techniques, Xpert Xpress and COVID 
Nudge are based on RT-PCR, and Accula is described as a PCR plus 
lateral flow assay. 


Multiple combinations of sample types and use of direct swab 
testing or swabs in viral transport medium or saline were 
reported across the studies (Table 1). The sample types used 
included combined naso- and oropharyngeal samples (n = 2), 
nasopharyngeal samples alone (n = 16), nasal alone (n = 2), 
oropharyngeal samples alone (n = 1), or a combination of two or 
more of either nasopharyngeal or nasal or oropharyngeal samples 
(n = 8). One evaluation used throat saliva or lower respiratory tract 
specimens, one used saliva samples alone and one did not specify 
the sample type used. Of the six studies using nasal samples either 
alone (n = 2) or for at least some participants (n = 4), one reported 


using nares swabs, and the remaining five did not specify the type 
of nasal sample used. 


Eight evaluations (25%) reported direct swab testing in some (n = 
1) or all (n = 7) samples, 18 (59%) used swabs in viral transport 
medium only (n = 12) or in viral transport medium or some other 
transport medium (n = 6), and six did not report whether they used 
any transport medium. 


Sample collection was described in only three evaluations (9%) 
(Gibani 2020; Harrington 2020; Rhoads 2020; Table 1); the remaining 
studies did not describe sample collection but it is likely that 
samples were collected as part of routine care by healthcare 
workers. Sample testing was clearly described as conducted on- 
site by medical personnel or by laboratory personnel at local 
laboratories in one of the studies reporting sample collection 
(Harrington 2020), while a second implied testing as soon as 
possible after collection, possibly by the same healthcare worker 
(Gibani 2020). Four (12.5%) evaluations stated that laboratory staff 
carried out the tests. In 16 of the remaining 26 studies, testing by 
laboratory staff was inferred, based on delays between collection 
and testing of 18 hours to seven days (n = 10), or reported use of 
archived or frozen samples (n = 6). The remaining eight evaluations 
provided no useful information regarding who carried out the test 
(Assennato 2020; Dust 2020; Ghofrani 2020; Jin 2020; Jokela 2020; 
Moran 2020; Rhoads 2020; SoRelle 2020). 


Two of the five manufacturers document IFU for samples stored 
in transport medium (Xpert Xpress and SAMBA II assays); two 
explicitly recommend against the use of viral transport medium (ID 
NOW and Accula), although at the time of the test evaluations some 
viral transport media were documented as acceptable for ID NOW; 
and one IFU does not mention the use of viral transport medium 
(COVID Nudge). Although immediate sample testing is preferred, 
all manufacturers document an acceptable period of refrigerated 
storage of between eight hours (COVID Nudge), and seven days with 
refrigeration (Xpert Xpress). See Appendix 13. 


We considered only nine of 32 (28%) evaluations to be compliant 
with manufacturer IFUs in regard to sample type, use of viral 
transport medium and time interval between collection and 
testing. Sixteen evaluations were not compliant with IFUs; eight 
used viral transport medium, six used frozen samples, and two 
tested samples not listed on the IFUs. For the remaining seven 
evaluations, either the testing interval from sample collection was 
unclear (n = 5) or saline was used but the IFU did not specifically 
address whether this was recommended or not (n = 2). 


Methodological quality of included studies 


We report the overall methodological quality assessed using the 
QUADAS-2 tool for all included studies (n = 78) in Figure 2 
(Whiting 2011). See Appendix 14 for separate summary plots by test 
method and for a plot of study-level ratings by quality domain. We 
explain how we reached these judgements in the Characteristics of 
included studies table. 
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Figure 2. Risk of bias and applicability concerns graph: review authors' judgements about each domain presented 
as percentages across included studies. Numbers in the bars indicate the number of studies 
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We considered whether the findings of individual studies were at 
risk of bias, and whether there were concerns that results might not 
apply to standard use of the tests. We did not judge any study at 
low risk of bias, although in 11 of 78 studies the only concern was 
that a single negative RT-PCR was used to confirm absence of COVID 
infection rather than the preferred two negative tests. All studies 
raised concerns regarding the applicability of their results, but in 
13 of 78 studies the only concern was the reliance on only PCR to 
identify SARS-CoV-2 cases (and nine of these 13 are in common with 
the 11 using a single negative RT-PCR). 


Participant selection 


We judged 22 studies (28%) to be at low risk of bias, and 29 (37%) 
at high risk of bias because of deliberate sampling of participants 
based on the reference standard result (n = 25; 16 two-group studies 
and nine that only included samples with confirmed SARS-CoV-2 
infection or absence of infection) or use of convenience sampling (n 
=4). In 27 studies (35%) the risk of bias was unclear because of poor 
reporting of recruitment procedures or inclusion criteria (Figure 2). 


Athird (27/78) of studies were likely to have selected an appropriate 
patient group, recruiting participants from COVID-19 test centres, 
urgent care or emergency departments or identified through 
contact tracing. We had high concerns about the applicability of 
the selected participants in almost half of studies (35/78). Recruited 
participants were unlikely to be similar to those in whom the test 
would be used in clinical practice because of deliberate sampling (n 
= 25) or sample inclusion based on the availability of residual and 
sometimes frozen samples, or both (n= 22). 


Index tests 


Poor reporting meant we could not clearly assess whether there 
was a risk of bias through performance of the index test in 41 
(53%) studies. In general, antigen test studies were of a higher 
methodological standard for the index test domain compared to 
studies of molecular tests (Figure 2). 


For antigen tests, we observed low risk of bias in 60% of studies 
(29/48). Risk of bias was unclear in the remaining studies because 
we could not judge whether interpretation of the index test was 
undertaken with knowledge of the reference standard result. For 
molecular tests, risk of bias was low in only 17% of studies 
(5/30). We observed high risk of bias in three studies (Moran 2020; 
Smithgall 2020 [A]; Wolters 2020) because they did not follow the 
manufacturer’s prespecified threshold for the Xpert Xpress test (re- 
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testing of samples with presumptive positive results). Risk of bias 
was unclear in 73% (22/30) of studies because they did not report 
blinding to the reference standard (n = 22), six of these studies also 
did not report how they handled presumptive positive results on 
Xpert Xpress. 


Fourteen studies (18%), including 13 antigen and one molecular 
test study, conducted testing as would be expected in practice 
(low concern regarding applicability). We had high concerns about 
applicability in half of all studies (39/78); 48% (23/48) of antigen and 
57% (16/30) of molecular studies. Twenty-seven (11 antigen and 16 
molecular) did not comply with manufacturers’ IFU and a further 
10 (all antigen studies), did not carry out tests as would occur 
in practice (i.e. trained, centralised laboratory staff carried out 
testing). In another two antigen studies concerns for applicability 
were high because tests were not available for purchase (Diao 
2020; Nash 2020). Of the remaining 25 studies (12 antigen and 
13 molecular) 16 conducted the test within the manufacturer IFU 
but none clearly described the setting for testing or personnel 
conducting the test. 


Reference standards 


Six studies were at low risk of bias for the reference standard. 
Although 12 used an appropriate reference standard, half (6/12) 
did not clearly implement blinding of the reference standard to the 
index test. High risk of bias (66/78) was present because studies did 
not use an adequate reference standard (Figure 2); they used either 
a single negative RT-PCR to define absence of SARS-CoV-2 infection 
(n = 64) or the index test formed part of a composite reference 
standard (n= 2). 


A total of 36 studies reported blinded RT-PCR interpretation, two 
(with composite reference standard) did not implement blinding, 
and 40 (51%) provided insufficient information about blinding of 
the reference standard to the index test to judge risk of bias. 


We judged 76 of the 78 studies to raise concerns about applicability 
(97%) because of defining the presence of SARS-CoV-2 infection 
based on a single RT-PCR-positive result. These studies will have 
excluded individuals who are RT-PCR-negative but have exposure 
and clinical features that meet the case definitions for COVID-19. 


Flow and timing 


Only 13 (17%) studies (all of antigen tests) were at low risk of 
bias for participant flow and timing (Figure 2). Twenty-nine (37%) 
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were at high risk of bias (19 antigen and 10 molecular) because of 
exclusion of samples following invalid index test results (n = 23); 
delays between ‘paired’ swabs of up to three days (n = 4), different 
reference standards used (n = 3), or because they provided results 
ona per sample instead of per patient basis (n= 2). These categories 
are not mutually exclusive. 


We judged risk of bias unclear for 36 (46%) studies, primarily 
because of lack of clarity about participant inclusion and exclusion 
from analyses (n = 34), with no missing data or indeterminate 
test results reported and no Standards for Reporting Diagnostic 
Accuracy Studies (STARD)-style participant flow diagram and 
checklist (Bossuyt 2015), to fully report outcomes for all samples. 


Conflicts of interest 


In 27 studies all authors declared no conflicts of interest, although 
one study that reported the validation of a new test included 
a co-author affiliated to the test manufacturing company. Of 
these 27 studies, 19 were independent evaluations published by 
FIND or were from national reference laboratories. Twenty studies 
did not provide a conflict of interest statement, including 13 
published studies and one study that reported affiliations to the 
test manufacturer. In the 12 remaining studies at least one author 
declared potential conflicts of interest in relation to the test. 


Twenty-six studies provided no funding statement, 12 reported no 
funding sources to declare, and the remainder (n = 40) reported one 
or more funding sources. 


Findings 


Of the 78 included studies, eight reported evaluations of more than 
one test using the same samples and one reported evaluations 
of three tests using different samples (Table 1). To include all 
results from all tests in these analyses we have treated results 
from different tests of the same samples within a study as separate 


data points, such that data are available on 91 test evaluations (58 
evaluations of antigen tests in 48 studies and 33 evaluations of rapid 
molecular tests in 30 studies). 


As previously stated, 77 of the 78 studies reported data for 
respiratory samples and one (Szymczak 2020), reported data for 
non-respiratory (faecal) samples. The main results, Tables and 
Figures focus on the respiratory samples, with Szymczak 2020 
reported separately. 


The results tables identify where estimates are based on multiple 
assessments of the same samples by including both the number 
of test evaluations and the number of studies. Nine datasets 
are from ‘cases only’ studies reporting only sensitivity estimates 
(six for antigen tests and three for molecular assays), and one 
antigen test evaluation is for ‘non-COVID-19’ cases reporting only 
specificity. Summary results are presented for studies providing 
both sensitivity and specificity data and then adding in the data 
from sensitivity- or specificity-only evaluations. The numbers of 
true positives, false positives, and total samples with and without 
confirmed SARS-CoV-2 infection are based on test result counts. 


We present results for antigen tests overall and by subgroup in Table 
2. Table 3 and Table 4 present results by test brand overall and by 
symptom status, and give results of sensitivity analyses restricting 
by compliance with manufacturer IFU. Forest plots of study data for 
the primary analysis are in Figure 3 and for subgroup analyses by 
symptom status and time after symptom onset are in Figure 4 and 
Figure 5. Appendix 15 provides forest plots for study data according 
to Ct value and study design. Individual plots by test brand are 
provided in Figure 6 for test brands with three or more evaluations 
and Figure 7 for test brands with one or two evaluations. Figure 8 
shows data from studies comparing the accuracy of two or more 
antigen assays. Full identification details for studies of antigen- 
based assays are provided in Appendix 9 and Appendix 10. 





Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 22 
Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 


Collaboration. 


Cochrane 
Library 


©) 


Trusted evidence. 
Informed decisions. 
Better health. 


Cochrane Database of Systematic Reviews 





Figure 3. Forest plot of studies evaluating antigen tests. BR: Brazil; CH: Switzerland; DE: Germany; HCW: healthcare 


worker; Lab: laboratory 
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Figure 4. Forest plot of data for antigen tests according to symptom status. A&E: accident and emergency; BR: 
Brazil; CH: Switzerland; DE: Germany; HCW: healthcare worker; Lab: laboratory 
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Figure 5. Forest plot of antigen test evaluations by week post symptom onset (pso). A&E: accident and emergency; 
Ag: antigen; BR: Brazil; CH: Switzerland; DE: Germany 
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Figure 6. Forest plot by test brand for assays with = 3 evaluations. BR: Brazil; CGIA: colloidal-gold immunoassay; CH: 
Switzerland; DE: Germany; FIA: fluorescent immunoassay; HCW: healthcare worker; IFU: instructions for use; Lab: 
laboratory; LFA: lateral flow assay 
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Figure 7. Forest plot by test brand for assays with <3 evaluations; CGIA: colloidal-gold immunoassay; FIA: 
fluorescent immunoassay; IFU: instructions for use; LFA: lateral flow assay 
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Figure 8. Forest plot of studies reporting comparative data. CGIA: colloidal-gold immunoassay; FIA: fluorescent 
immunoassay; LFA: lateral flow assay; nos: not otherwise specified 
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Porte 2020b [B] 29 #1 3°31 FIA SD Biosensor - STANDARD F COVID-19 Ag 0,91 [0.75, 0.98] 0.97 [0,84, 1.00] — — 
Weitzel 2020 [A] 49 0 30 30 CGIA RapiGEN - BIOCREDIT COVID-19 Ag 0.62 [0.50, 0.73) 1,00 [0.88, 1.00] foe oad 4 
Weitzel 2020 [B] o ol 9 9 CGIA Liming Bio-Products - StrongStep 0,00 [0.00, 0.34) 0.90 (0.55, 1.00) #—— —F 
Weitzel 2020 [C] 130 65 31 LFA (nos) Savant Biotech - Huaketai SARS-CoV-2 N 0.17 [0.09, 0.27) 1.00 [0.89, 1.00) — 4 
Weitzel 2020 [D] 68 0 12 31 FIA Shenzhen Bioeasy Biotech - 2019-nCoV Ag 0.85 [0.75, 0,92] 1,00 [0,89, 1.00) | ++ = k ' = 
00.204060.8 1 bofzo'ao'e oe 1 


Results for molecular tests overall and by subgroup are reported 
in Table 5. Forest plots of study data for the primary analysis is 
in Figure 9 and for subgroup analyses by Ct value, study design 
and sensitivity analyses by pre- and post-discrepant analysis in 


Appendix 16. Individual plots by test brand are provided in Figure 
10. Full identification details for studies of molecular-based assays 
are provided in Appendix 11 and Appendix 12. Appendix 17 provides 
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forest plots for study data according to Ct value and discrepant 
analysis. 





Figure 9. Forest plot of studies evaluating rapid molecular tests. A&E: accident and emergency 








Study TP FP FN TN Symptom status Setting Sensitivity (95% Cl} Specificity (95% Cl} Sensitivity (95% Cl}Specificity (95% CI} 
Chen 2020a 55 0 0 ie} Symptomatic Hospital in-patient 1,00 [0.94, 1,00] Not estimable al 

Wong 2020 118 GO 1 43 Symptomatic Laboratory-based 0,99 [0.95, 1.00] 1,00 [0.92, 1.00] a =a 
Assennato 2020 87 3 1 81 Symptomatic Laboratory-based 0,99 [0.94, 1,00] 0,96 [0.90, 0.99] a + 
Zhen 2020 [B] 57 Oo 1 50 Symptomatic Laboratory-based 0,98 [0,91, 1.00) 1,00 [0,93, 1.00) = el 
Gibani 2020 67 O 4 315 Symptomatic Mixed 0,94 [0.86, 0.98] 1,00 [0.99, 1.00] al . 
Cradic 2020(b} 12 0 1 169 Symptomatic Hospital A&E 0,92 [0.64, 1.00] 1,00 [0,.98, 1.00] — Ld 
Cradic 2020(a) 30 O 3 151 symptomatic Mixed 0,91 [0.76, 0.98] 1,00 [0.98, 1.00] — . 
Collier 2020 29 3 #44113 Symptomatic Hospital in-patient 0,88 [0,72, 0.97] 0,97 [0,93, 0.99] Ss al 
Zhen 2020 [A] 50 0 7 50 Symptomatic Laboratory-based 0,88 [0,76, 0.95] 1,00 [0,93, 1.00) —- 4 
SoRelle 2020 32 0 7 44 Symptomatic Laboratory-based 0,82 [0.66, 0,92] 1,00 [0,92, 1,00] ss 4 
Moore 2020 94 0 25 79 symptomatic Mixed 0,79 [0,71, 0,86] 1.00 [0,95, 1,00] ad a 
Harrington 2020 139 2 47 336 symptomatic Hospital A&E 0.75 [0,68, 0,81] 0,99 [0,98, 1,00] all . 
Thwe 2020 8 oO 6 147 Symptomatic Laboratory-based 0.57 [0,29, 0.82] 1.00 [0.98, 1.00] —_1— . 
Jokela 2020 60 O QO 30 Not reported Laboratory-based 1,00 [0,94, 1,00) 1.00 [0.88, 1.00] 4 4 
Lieberman 2020 13 0 O 13 Not reported Laboratory-based 1,00 [0.75, 1,00) 1.00 [0.75, 1.00] — —! 
Lephart 2020 [B] 16 2 0 56 Not reported Hospital A&E 1.00 [0.79, 1,00] 0.97 [0.88, 1.00] — 4 
Dust 2020 20 0 O 18 Not reported Laboratory-based 1.00 [0.83, 1.00] 1.00 [0.81, 1.00] — — 
Goldenberger 2020 10 Oo @O 9 Not reported Laboratory-based 1.00 [0.69, 1.00] 1.00 [0.66, 1.00] — — 
Wolters 2020 58 oOo oO 30 Not reported Laboratory-based 1.00 [0.94, 1.00] 1.00 [0.88, 1.00] 4 4 
Moran 2020 42 1 0 60 Not reported Laboratory-based 1,00 [0.92, 1.00] 0,98 [0.91, 1.00] 4 41 
Loeffelholz 2020 219 11 1 250 Not reported Laboratory-based 1.00 [0.97, 1.00] 0.96 [0.93, 0.98] 2 a 
Smithgall 2020 [B] 87 2 1 23 Not reported Laboratory-based 0.99 [0.94, 1.00] 0.92 [0.74, 0.99] a — 
Broder 2020 34 0 1 fe] Not reported Laboratory-based 0.97 [0.85, 1.00] Not estimable = 

Hou 2020 147 5 6 127 Not reported Laboratory-based 0.96 [0.92, 0.99] 0.96 [0.91, 0.99] a a 
Rhoads 2020 90 0 6 fe] Not reported Laboratory-based 0.94 [0.87, 0.98] Not estimable al 

Smithgall 2020 [A] 65 0 23 25 Not reported Laboratory-based 0.74 [0.63, 0.83] 1.00 [0.86, 1.00] a — 
Mitchell 2020 33:0 13 “15 Not reported Laboratory-based 0,72 [0.57, 0.84] 1.00 [0.78, 1.00] —= — 
Lephart 2020 [A] 11 oO 5 59 Not reported Hospital A&E 0.69 [0.41, 0.89] 1.00 [0,94, 1.00] —_— i 4 
Hogan 2020 34 016 50 Not reported Laboratory-based 0,68 [0,53, 0.80] 1,00 [0,93, 1.00] — al 
Stevens 2020 53 0 1 50 Mixed Laboratory-based 0,98 [0,90, 1.00) 1,00 [0,93, 1.00] = al 
Ghofrani 2020 1661 #21 $5 Mixed Mixed 0,94 [0,71, 1.00] 0,99 [0,94, 1.00] — al 
Jin 2020 4 0 2 46 Mixed Laboratory-based 0.67 [0.22, 0,96] 1.00 [0,92, 1.00] I S| S44 = 
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Figure 10. Forest plot by test brand for molecular assays. A&E: accident and emergency; IFU: instructions for use 


Study TP FP FN TN IFU compliant Sensitivity (95% Cl} Specificity (95% Cl) Sensitivity (95% Cl)Specificity (95% Cl} 
Zhen 2020 [A] 50 0 7 50 No 0,88 [0.76, 0.95] 1.00 [0.93, 1.00] + 4 
Rhoads 2020 90 0 6 ff) No 0,94 [0.87, 0,98] Not estimable al 

Moore 2020 94 0 25 79 No 0.79 [0.71, 0.86] 1,00 [0,95, 1.00] all ial 
SoRelle 2020 32 0 7 44 No 0,82 [0.66, 0.92] 1,00 [0.92, 1.00 + 4 
Smithgall 2020 [A] 65 0 23 25 No 0,74 [0.63, 0,83] 1,00 [0,86, 1.00 a —- 
Mitchell 2020 33013 #15 No 0,72 [0.57, 0,84] 1.00 [0.78, 1.00 == — 
Cradic 2020{a) 30 0 3 151 No 0,91 [0.76, 0.98] 1,00 [0,98, 1.00 — a 
Ghofrani 2020 16061 «#21 «$5 No 0,94 [0.71, 1.00] 0.99 [0,94, 1.00 — a 
Cradic 2020{(b) 12 0 1 169 Unclear 0,92 [0.64, 1.00] 1.00 [0.98, 1.00 —F . 
Thwe 2020 8 O 6 147 Yes 0.57 [0,29, 0,82] 1,00 [0,98, 1.00] —_—*— a 
Jin 2020 4 0 2 46 Yes 0.67 [0.22, 0,96] 1.00 [0,92, 1.00 —— 4 
Harrington 2020 139 2 47 336 Yes 0.75 [0.68, 0.81] 0,99 [0.98, 1.00 all . 
Lephart 2020 [A] 11 0 5 59 Yes 0,69 [0,41, 0,89] 1,00 [0,94, 1.00 —_——- 


Cepheid - Xpert Xpress (Automated RT-PCR} 





b+ + 4 4 
00.20.4060.81 0020406081 


Study TP FP FN TN IFU compliant Sensitivity (95% CI} Specificity (95% Cl) Sensitivity (95% Cl}Specificity (95% CI} 
Zhen 2020 [B] 57 Oo 1 50 No 0.98 [0.91, 1.00 1,00 [0,93, 1.00] 4 4 
Wong 2020 118 O 1 43 No 0,99 [0,95, 1,00] 1,00 [0,92, 1.00] a 4 
Wolters 2020 58. 0 OF 30 No 1.00 [0.94, 1.00 1.00 [0.88, 1.00] 4 4 
Stevens 2020 53 0 1 50 No 0,98 [0,90, 1,00 1,00 [0,93, 1.00] 4 4 
Chen 2020a 55 0 O 10] No 1.00 [0.94, 1,00 Not estimable 4 

Hou 2020 147 3 6 127 No 0.96 [0.92, 0.99 0.96 [0.91, 0.99] al al 
Goldenberger 2020 10 0 0 9 No 1,00 [0.69, 1,00 1,00 [0,66, 1.00] —1 —41 
Smithgall 2020 [B] 87 2 1 23 Unclear 0,99 [0.94, 1.00 0.92 [0.74, 0.99] al — 
Moran 2020 42 1 © 60 Unclear 1.00 [0.92, 1.00 0.98 [0.91, 1.00] 4 4 
Jokela 2020 60 Oo O 30 Unclear 1,00 [0,94, 1,00 1,00 [0,88, 1.00] 4 4 
Loeffelholz 2020 219 11 1 250 Unclear 1.00 [0.97, 1,00 0.96 [0.93, 0.98] Ld a 
Dust 2020 20 0 GO 18 Unclear 1.00 [0.83, 1.00 1.00 [0.81, 1.00) — — 
Broder 2020 34 0 21 ie] Yes 0.97 [0.85, 1.00 Not estimable 4 

Lephart 2020 [B] 16 2 0 56 Yes 1.00 [0.79, 1.00 0.97 [0.88, 1.00] —_ 4 
Lieberman 2020 13 0 GO 13 Yes 1.00 [0.75, 1.00 1.00 [0.75, 1.00) — 





DNANudge - COVID Nudge (Automated RT-PCR} 


Study 


Gibani2020 67 O 4 315 Yes 


DRW - SAMBA II (Automated RT-PCR) 


TP FP FN TN IFU compliant Sensitivity (95% Cl) Specificity (95% CI} 
0.94 [0,86, 0.98] 


0020406081 0020406081 


Sensitivity (95% Cl}Specificity (95% CI} 
1.00 [0.99, 1.00] + 
0020406081 0020406081 


Study TP FP FN TN IFU compliant Sensitivity (95% CI} Specificity (95% CI} Sensitivity (95% Cl}Specificity (95% CI} 
Assennato 2020 87 3 1 41 Unclear 0,99 [0,94, 1.00] 0,96 [0,90, 0,99] 4a + 
Collier 2020 29 3 4113 Yes 0,88 [0.72, 0.97] 0.97 [0,93, 0.99] = 4 


Mesa Biotech - Accula {other molecular} 


Study 


Hogan 2020 34 O 16 50 No 


Accuracy of antigen tests overall and by subgroup 


Results showed high levels of heterogeneity in sensitivity. Average 
sensitivity was 68.9% (95% Cl 61.8% to 75.1%) and average 
specificity was 99.6% (95% Cl 99.0% to 99.8%) across the 
51 evaluations of antigen tests reporting both sensitivity and 
specificity (based on 21,614 samples, including 6136 samples with 
confirmed SARS-CoV-2; Table 2; Figure 3). Adding the six ‘sensitivity 
only’ datasets and single ‘specificity only’ datasets had a negligible 
impact on results (Table 2). In the sections below we show that 
there are substantial differences between subgroups of studies 
according to symptom status, timing, test method and brand, 
therefore this average value is unlikely to accurately predict the 
performance of the test in a given setting and should not be used 
for this purpose. 


TP FP FN TN IFU compliant Sensitivity {95% CI) Specificity (95% CI) 
0.68 [0.53, 0.80) 


0020406081 0020406081 


Sensitivity (95% Cl}Specificity (95% CI} 


+——+ —+ 


1.00 [0.93, 1.00] 
5 0.20.40.6 of rh 5 of ofa Of O's 7 





Subgroup analysis by symptom status 


Subgroup analysis by symptom status suggests that average 
test sensitivity to detect infection is 13.8 percentage points 
lower in asymptomatic (58.1%, 95% Cl 40.2% to 74.1%; based 
on 12 evaluations, 1581 samples and 295 cases) compared to 
symptomatic (72.0%, 95% Cl 63.7% to 79.0%; based on 37 
evaluations, 15,530 samples and 4410 cases) participants (95% Cl 
for the difference in sensitivity: 33.1 percentage points lower to 
5.4 percentage points higher; Table 2; Figure 4). Restricting the 
comparison by symptom status to the nine evaluations reporting 
data for both symptomatic and asymptomatic subgroups (thus 
ensuring the comparison is made between the same tests used 
in the same way) showed a similar difference in sensitivity (14.4 
percentage points lower in asymptomatic participants, 95% Cl 38.8 
lower to 10.0 percentage points higher; Table 2). Average results 
for the 19 evaluations in participants with mixed symptom status 





Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 29 
Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 


Collaboration. 


Trusted evidence. 
Informed decisions. 
Better health. 


+‘ Cochrane 
tw Library 


Cochrane Database of Systematic Reviews 





(n = 10) or symptom status not reported (n = 9) were between 
those observed for the symptomatic and asymptomatic subgroups: 
sensitivity 63.0% (95% Cl 52.2% to 72.6%) and specificity 98.4% 
(95% Cl 98.0% to 98.8%) (6220 samples; 2392 cases). 


We did not observe any important differences in specificity 
according to symptom status (Table 2). 


Subgroup analysis by time from symptom onset 


We pooled data by time from symptom onset separately for 
sensitivity and specificity because the majority of evaluations did 
not report these data for people without SARS-CoV-2 (Table 2; 
Figure 5). Sensitivity was 78.3% (95% Cl 71.1% to 84.1%) (26 
evaluations; 5769 samples, 2320 cases) in the first seven days 
after symptom onset compared to 51.0% (40.8% to 61.0%) (22 
evaluations; 935 samples, 692 cases) in the second week of 
symptoms (a decrease of 27.3 percentage points, 95% Cl -32.8 to 
-21.9 percentage points decrease). This difference remained on 
restriction to the 22 evaluations reporting data for people in both 
week one and week two of symptoms (removing other between- 
study differences; Table 2). 


We did not observe any differences in specificity according to time 
after symptom onset (Table 2). 


Subgroup analysis by Ct value 


A total of 36 evaluations reported sensitivity according to Ct value 
using a threshold of 24 (n = 18) or 25 (n = 18) Ct or less to define 
higher viral load (Table 2; Appendix 15). Summary sensitivity in 
those with higher viral load was 94.5% (95% Cl 91.0% to 96.7%) 
(based on 2613 cases), compared to 40.7% in those with lower 
viral load (95% Cl 31.8% to 50.3%) (based on 2632 cases) (i.e. 
sensitivity was 53.8 percentage points lower for those with lower 
viral load; 95% Cl 63.6 to 44.1 percentage points lower)). Applying a 
Ct threshold of < 33 (n= 13) or <32 (n=2) led to a bigger difference in 
sensitivity although the number of samples in the lower viral load 
subgroup was considerably smaller: sensitivity associated with 
higher viral load was 82.5% (95% Cl 74.0% to 88.6%) (based on 2127 
samples) and for lower viral load was 8.9% (3.3% to 21.7%) (based 
on 346 samples), a difference of 73.5 percentage points (95% Cl 84.7 
to 62.4 percentage points lower). 


Subgroup analysis by study design 


We did not observe any clear differences in average sensitivity 
or specificity when studies were grouped by study design (15,336 
samples and 3536 cases in 29 single group studies and 5729 
samples and 2396 cases in 20 two-group studies; Table 2; Appendix 
15). Average sensitivity was lower in two-group studies (64.1%, 95% 
Cl 48.5% to 77.2%) compared to single-group studies (72.1%, 95% 
Cl 64.8% to 78.3%), however confidence intervals overlapped and 
the difference was within that which may be expected by chance 
(8.0 percentage points lower, 95% Cl from 24.2 percentage points 
lower to 8.2 higher). Average specificities were 2.3 percentage 
points lower in the two-group studies (95% Cl from 2.9 to 1.6 
percentage points lower), at 97.3% (95% Cl 96.7% to 97.8%) 
compared to 99.6% (95% Cl 99.1% to 99.8%) in single-group 
studies. 


Subgroup analysis by test method 


We observed differences in accuracy according to test method 
(Table 2). The majority of evaluations (n = 36; 17,448 samples, 


5085 cases) reported using a CGIA, average sensitivity was lower 
(64.0%, 95% C1 55.7% to 71.6%) than for FIAs (79.6%, 95% Cl 67.5% 
to 88.0%; n = 9; 2820 samples, 712 cases; absolute difference of 
15.6 percentage points, 95% Cl 2.6 to 28.5 percentage points). We 
also observed marginal differences in specificity, with estimates 
of 99.0% (95% Cl 98.8% to 99.2%) for CGIA and 97.7% (95% Cl 
95.3% to 98.8%) for FIA, a difference of 1.3 percentage points (95% 
from 3.0 percentage points lower to 0.3 higher). Results for lateral 
flow assays where the method could not be determined (n = 5) 
and for the single evaluation of an alkaline phosphatase (ALP)- 
labelled assay were heterogeneous but largely in the realms of 
those observed for the other assay types (Table 2). 


Results by test brand according to symptom status and IFU 
compliance 


Results by test brand overall and sensitivity analyses by IFU 
compliance (based on sample type, use of viral transport medium, 
and time period between sample collection and test procedure) 
are reported in Table 3. Results by test brand for symptomatic 
and asymptomatic subgroups overall and by IFU compliance are 
in Table 4. Given the mixed settings in which asymptomatic 
individuals were tested (Results of the search), the data for 
asymptomatic subgroups cannot be considered applicable to any 
particular scenario for asymptomatic testing. Only three studies 
reported direct comparisons of tests, two using nasopharyngeal or 
oropharyngeal samples (Fourati 2020 [A]; Weitzel 2020 [A]). 


We observed considerable heterogeneity in sensitivities for all 
assays. 


AAZ - COVID-VIRO 


Two evaluations of the COVID-VIRO assay included 880 samples 
and 396 SARS-CoV2-positive samples (Figure 7). We did not pool 
the studies due to the heterogeneity in both sensitivity and 
specificity, although both were conducted in symptomatic or 
mainly symptomatic participants using nasopharyngeal samples. 


In one study that compared antigen assays using nasopharyngeal 
samples in viral transport medium, sensitivity was 61.7% (95% Cl 
55.9% to 67.3%) and specificity (in pre-pandemic samples) 100% 
(95% Cl 98.9% to 100%; 632 samples, 295 cases;'Fourati 2020 [E]). 


The second study used direct swab testing in compliance with 
the manufacturer’s IFU. Twenty participants in the study who 
previously tested positive on PCR retested negative with PCR at 
the time of the antigen test. All twenty samples showed weak lines 
on antigen testing. We considered these as false positives in the 
review (based on the negative result of the concurrent PCR test) 
whereas the study authors considered them to be true positives. 
With our re-calculation, the test demonstrated sensitivity of 96.0% 
(95% Cl 90.2% to 98.9%) and specificity of 86.4% (95% Cl 79.8% to 
91.5%; Courtellemont 2020). Sensitivity in this study may have been 
inflated by the inclusion of hospitalised, confirmed SARS-CoV-2- 
positive participants. 


Abbott - Panbio Covid-19 Ag 


We identified 11 evaluations of the Panbio assay, including 5691 
unique samples, with 2031 SARS-CoV-2-positive cases (Figure 6). 
One of the 11 evaluations included only SARS-CoV-2-positive cases 
(n = 182 samples). Studies were conducted in community COVID-19 
test centres or emergency departments (n = 6), in contacts of 
confirmed cases (n = 2), and laboratory-based evaluations (n = 2). 
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The setting was not clear in one study. Participants were reportedly 
symptomatic (n = 5), asymptomatic (n = 1), with mixed symptom 
status (n = 4), or symptom status was not reported (n = 1). Nine 
evaluations used nasopharyngeal samples (Albert 2020; Billaud 
2020; Fenollar 2020(b); FIND 2020b; Fourati 2020 [C]; Gremmels 
2020(a); Gremmels 2020(b); Linares 2020), one (Alemany 2020), 
tested nasopharyngeal or nasal samples and one (Schildgen 2020 
[A]), used bronchoalveolar lavage or throat wash samples. Only 
three of the 11 evaluations reported product codes for the assays 
used, one of which was for the assay for use with nasopharyngeal 
swabs (41FK10) and two (from the same study report) were 
for the assay for use with nasal swabs (41FK11), although the 
study reports using nasopharyngeal samples (Gremmels 2020(a); 
Gremmels 2020(b)). 


Five of the 11 evaluations complied with manufacturer IFU for the 
test. Reasons for non-compliance included use of viral transport 
medium, frozen storage, type of swab tested, or lack of clear 
reporting of test procedures used. 


The average sensitivity and specificity of the Panbio assay were: 


* 72.0% (95% Cl 60.6% to 81.1%) and 99.3% (95% Cl 99.0% to 
99.6%) overall (n = 10; 5509 samples; 1849 cases; Table 3); 


© 74.1% (95% Cl 60.8% to 84.0%) and 99.8% (95% Cl 99.5% to 
99.9%) in symptomatic people (n = 8; 3699 samples, 1162 cases); 
and 

© 58.1% (95% Cl 41.7% to 72.9%) and 98.4% (95% Cl 92.2% to 
99.7%) in asymptomatic people (n = 6; 1097 samples, 190 cases; 
Table 4). 


Restricting to IFU-compliant evaluations, average sensitivities and 
specificities were: 


* 72.0% (95% Cl 56.5% to 83.5%) and 99.2% (95% Cl 98.5% to 
99.5%) overall (n = 5; 1776 samples, 362 cases; Table 3); 


© 75.1% (95% Cl 57.3% to 87.1%) and 99.5% (95% Cl 98.7% to 
99.8%) in symptomatic people (n = 3; 1094 samples, 252 cases); 
and 

* 48.9% (95% Cl 35.1% to 62.9%) and 98.1% (95% Cl 96.3% to 
99.1%) in asymptomatic people (n = 2; 474 samples, 47 cases; 
Table 4). 


The addition of one evaluation that reported sensitivity only 
in symptomatic participants led to only marginal differences in 
average sensitivity (Fenollar 2020(a); Table 4). 


Becton Dickinson - BD Veritor 


We identified three evaluations of the BD Veritor assay, including 
727 unique samples, with 180 SARS-CoV-2-positive cases (Figure 
6). One of the three evaluations included only SARS-CoV-2-positive 
cases (n = 125 samples). Studies were conducted in community 
COVID-19 test centres (n = 2), or in multiple settings (n = 1). All 
participants were symptomatic. Two evaluations used combined 
naso- and oropharyngeal samples and one tested nasal samples. 


None of the evaluations complied with manufacturer IFU for the 
test because the interval between sample collection and testing 
was greater than the maximum of one hour. 


Average sensitivity and specificity of the BD Veritor assay were: 


© 82.3% (95% Cl 62.1% to 93.0%) and 99.5% (95% Cl 98.3%, 99.8%) 
in symptomatic people (n = 2; 602 samples, 55 cases; Van der 
Moeren 2020(a); Young 2020; Table 3; Table 4). 


Adding the ‘cases only’ evaluation reduced average sensitivity to 
79.4% (95% Cl 72.9% to 84.7%) (n = 3; 180 cases; Van der Moeren 
2020(b)). 


The BD Veritor assay requires interpretation using a Veritor analyzer 
device, but Van der Moeren 2020(a) found that visual inspection of 
the test device resulted in the same sensitivity as with the Analyzer 
device, and similar specificity (100% compared to 99% using the 
Analyzer device). 


BIONOTE - NowCheck COVID-19 Ag 


We identified a single IFU-compliant evaluation of the NowCheck 
assay in symptomatic participants (FIND 2020a; Figure 7). The 
study included 400 samples with 102 SARS-CoV-2-positive cases, 
from participants presenting at a community-based COVID-19 test 
centre. 


The sensitivity and specificity in this study were 89.2% (95% Cl 
81.5% to 94.5%) and 97.3% (95% Cl 94.8% to 98.8%; Table 3; Table 
4). 


Biosynex - Biosynex COVID-19 Ag BSS 


We identified a single evaluation of the Biosynex assay in 
symptomatic participants (Fourati 2020 [D]), including 634 samples 
with 297 with confirmed SARS-CoV-2 (Figure 7). The evaluation was 
not in compliance with the manufacturer’s IFU because samples 
were stored in viral transport medium and frozen prior to testing. 
The setting in which participants presented for testing was not 
reported. 


Observed sensitivity was 59.6% (95% Cl 53.8% to 65.2%) and 
specificity 100% (95% Cl 98.9% to 100%; Table 3; Table 4). 


Coris Bioconcept - COVID-19 Ag Respi-Strip 


The seven evaluations of the Coris Bioconcept assay included 1781 
samples, with 707 SARS-CoV-2-positive cases (Blairon 2020; Fourati 
2020 [A]; Kruger 2020(b); Lambert-Niclot 2020; Mertens 2020; Scohy 
2020; Veyrenche 2020; Figure 6). Five of the seven were laboratory- 
based evaluations with limited detail regarding study participants. 
One study recruited from community-based COVID-19 test centres 
and one included samples from hospital inpatients. Three studies 
included only or mainly symptomatic participants, one was in a 
mixed group and three did not report symptom status. 


All evaluations tested naso- or oropharyngeal swabs and were 
compliant with the manufacturer IFU, however, it may be worth 
noting that the IFU for this assay permits the use of viral transport 
medium and freezing of samples, although immediate testing is 
recommended. 


The average sensitivity and specificity of the COVID-19 Ag Respi- 
Strip were: 


© 39.7% (95% Cl 31.3% to 48.7%) and 98.3% (95% Cl 97.4% to 
98.9%) overall (n = 7; 1781 samples, 707 cases; Table 3); 

© 34.1% (95% Cl 29.7% to 38.8%) and 100% (95% Cl 99.0% to 
100%) in symptomatic people (n = 3; 780 samples, 414 cases); 
and 
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* 28.6% (95% Cl 8.4% to 58.1%) and 100% (95% Cl 88.8% to 100%) 
in asymptomatic people (n= 1; 45 samples, 14 cases; Scohy 2020; 
Table 4). 


E25Bio - DART (nasopharyngeal) 


We identified a single evaluation of the E25Bio DART assay that 
included 190 samples, 100 with SARS-CoV-2 (Nash 2020; Figure 7). 
The symptom status of included participants was not reported and 
the manufacturer IFU is not yet available as the assay has been 
submitted for Emergency Use Authorisation (EUA) approval with 
the US Food and Drug Administration (FDA). 


Sensitivity was 80.0% (95% Cl 70.8% to 87.3%) and specificity 91.1% 
(95% Cl 83.2% to 96.1%; Table 3). 


Fujirebio - ESPLINE SARS-CoV-2 


We included two eligible evaluations were included, with a total 
of 265 samples, 165 were SARS-COV-2-positive (Nagura-Ikeda 2020; 
Takeda 2020; Figure 7). One study reported only sensitivity data 
(Nagura-Ikeda 2020). 


Takeda 2020 reported sensitivity of 80.6% (95% Cl 68.6% to 89.6%) 
and specificity of 100% (95% Cl 96.4% to 100%) in nasopharyngeal 
samples (162 samples, 62 cases; Table 3). They did not report 
symptom status of participants and provided insufficient detail to 
allow us to judge IFU compliance. 


Nagura-Ikeda 2020 evaluated the assay using saliva samples 
in symptomatic participants (not within IFU specifications), the 
ESPLINE assay correctly identified 12 of 103 PCR-positive samples 
(sensitivity 11.6%, 95% Cl 6.2% to 19.5%; Table 3; Table 4). 


Innova Medical Group - Innova SARS-CoV-2 Ag 


We included one report that evaluated the Innova study as 
six separate substudies; three reported both sensitivity and 
specificity (PHE 2020(a); PHE 2020(b); PHE 2020(c) [non-HCW 
tested]), two reported sensitivity alone (PHE 2020(d) [HCW tested]; 
PHE 2020(d) [Lab tested]), and one reported specificity alone 
(PHE 2020(e); Figure 6). The studies reported a total of 3904 
participants, including 1017 SARS-CoV-2-positive cases. Detail 
regarding symptom status, was limited, however the study 
populations were coded as: symptomatic (samples from hospital 
inpatients in PHE 2020(a)), mainly symptomatic for samples from 
COVID-19 testing centres (PHE 2020(c) [non-HCW tested]; PHE 
2020(d) [HCW tested]; PHE 2020(d) [Lab tested]), although data 
on symptom status were reported for only two of these studies 
(PHE 2020(d) [HCW tested]; PHE 2020(d) [Lab tested]), not reported 
for the outbreak investigation in PHE 2020(b) and asymptomatic 
staff screening for PHE 2020(e). The study authors for the outbreak 
evaluation study did not report the sensitivity value of 28.3% (95% 
Cl 16.0% to 43.5%) in the publications but provided it to us on 
request. 


All evaluations used naso- or oropharyngeal samples, two in viral 
transport medium (PHE 2020(a); PHE 2020(b)), and four using direct 
swab testing in compliance with manufacturer IFU (PHE 2020(c) 
[non-HCW tested]; PHE 2020(d) [HCW tested]; PHE 2020(d) [Lab 
tested]; PHE 2020(e)). 


For studies reporting both sensitivity and specificity, average 
sensitivity and specificity were: 


° 47.9% (95% Cl 34.3% to 61.8%) and 99.8% (95% Cl 99.5% to 
99.9%) overall (n = 3; 2945 samples, 596 cases; Table 3); and 

© 56.2% (95% Cl 52.0% to 60.3%) and 99.8% (95% Cl 99.5% to 
99.9%) in symptomatic people (n = 2; 2794 samples, 550 cases; 
Table 4). 


Only one of the three studies that reported both sensitivity and 
specificity was compliant with manufacturer IFU, the sensitivity 
and specificity were: 


© 57.5% (95% Cl 52.3% to 62.6%) and 99.6 (95% Cl 99.1%, 99.9%) 
overall (n = 1; 1676 samples, 372 cases). 


Summary results from the four IFU-compliant evaluations were 
calculated as follows: 


* average sensitivity across three evaluations of mainly 
symptomatic participants 69.1% (95% Cl 58.3% to 78.2%; n = 3; 
793 cases; Table 3; Table 4); 

* average specificity from two evaluations of 99.7% (95% Cl 99.3% 
to 99.9%; n = 2; 1842 samples with no SARS-CoV-2; Table 3). 


Adding data from single-group evaluations in either RT-PCR- 
positive or RT-PCR-negative participants: 


* average sensitivity was 59.0% (43.4%, 73.0%) (n = 5; 1015 cases) 
* average specificity was 99.8% (99.5%, 99.9%) (n= 4; 2887 RT-PCR 
negative samples) (Table 4). 


Results for each of the three IFU-compliant evaluations by test 
operator were (Figure 6): 


* sensitivity of 57.5% (95% Cl 52.3% to 62.6%) and specificity 
99.6% (95% Cl 99.1% to 99.9%), when the test was used by self- 
trained, non-healthcare workers (n = 1; 1676 samples, 372 cases; 
PHE 2020(c) [non-HCW tested)]); 


« sensitivity of 70.0% (95% Cl 63.5% to 75.9%) when the test was 
used by healthcare workers (n = 1; 223 cases; PHE 2020(d) [HCW 
tested]); 


* sensitivity of 78.8% (95% Cl 72.4% to 84.3%) when the test was 
used by laboratory scientists (n = 1; 198 cases; PHE 2020(d) [Lab 
tested]). 


Liming Bio-Products - StrongStep® COVID-19 Ag 


We identified a single evaluation of the StrongStep assay in 
19 symptomatic participants with nine SARS-CoV-2 positive 
samples ((Weitzel 2020 [B]; Figure 7). We could not identify the 
manufacturer’s IFU for this assay. The study authors terminated the 
evaluation early following poor early results for this assay. 


Sensitivity was 0% (95% Cl 0% to 33.6%) and specificity 90.0% (95% 
CI 55.5% to 99.7%; 19 samples, 9 cases; Table 3; Table 4). 


Quidel Corporation - SOFIA SARS Antigen 


We identified a single evaluation of the SOFIA assay in symptomatic 
participants, including 64 samples with 32 SARS-CoV-2-positive 
cases (Porte 2020b [A]; Figure 7). The study used combined 
naso- and oropharyngeal swab samples in viral transport medium, 
therefore the evaluation was not compliant with the manufacturer 
IFU. 


Sensitivity was 93.8% (95% Cl 79.2% to 99.2%) and specificity was 
96.9% (95% Cl 83.8% to 99.9%; Table 3; Table 4). 
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RapiGEN - BIOCREDIT COVID-19 Ag 


We identified six evaluations of the RapiGen BIOCREDIT assay; 
these reported data for 2170 samples, with 470 confirmed SARS- 
COV-2-positive cases (FIND 2020e (BR); FIND 2020e (DE); Mak 
2020; Schildgen 2020 [A]; Shrestha 2020; Weitzel 2020 [A]; Figure 
6). One laboratory-based study included cases only (n = 160). 
The other evaluations included participants from community- 
based COVID-19 test centres (n = 2), emergency departments (n 
= 1), contact tracing (n = 1) or did not clearly report the setting 
(n = 1). Two studies included only symptomatic participants, 
two reported including both symptomatic and asymptomatic 
participants (mixed group) and one did not report symptom 
status. All evaluations apart from one (Schildgen 2020 [A]), tested 
nasopharyngeal or combined naso- or oropharyngeal samples. 


Only three of the six evaluations complied with manufacturer IFU, 
with non-compliance because of the use of viral transport medium, 
or the type of swab tested. 


The average sensitivity and specificity of the BIOCREDIT assay were: 


* 63.3% (95% Cl 45.7% to 78.0%) and 99.5% (95% Cl 99.1 to 99.8) 
overall (n = 5; 2010 samples, 310 cases; Table 3); 

« 58.4% (95% Cl 36.3% to 77.5%) and 96.4% (95% Cl 82.8% to 
99.3%) in symptomatic people (n = 3; 608 samples, 206 cases); 

* 63.2% (95% Cl 21.7% to 91.4%) and 98.9% (95% Cl 82.9% to 
99.9%) in asymptomatic people (n = 2; 140 samples, 60 cases) 
(Table 4). 


Restricting to IFU-compliant evaluations, average sensitivities and 
specificities were: 


© 73.0% (95% Cl 57.4% to 84.4%) and 99.8% (95% Cl 99.4% to 
99.9%) overall (n = 3; 1828 samples, 189 cases; Table 3); 


* 74.4% (95% Cl 65.5% to 82.0%) and 98.9% (95% Cl 97.2% to 
99.7%) in symptomatic people (n = 1; 476 samples, 117 cases); 

* 85.1% (95% Cl 71.7% to 93.8%) and 100% (95% Cl 94.6% to 
100%) in asymptomatic people (n = 1; 113 samples, 47 cases; 
Shrestha 2020; Table 4). 


The addition of one evaluation that reported sensitivity only led toa 
decrease in overall average sensitivity of 5.6 percentage points (Mak 
2020; Table 4). 


Roche - SARS-CoV-2 


According to the manufacturer IFU, the Roche SARS-CoV-2 assay is 
available under a partnership with SD Biosensor. 


There was a single evaluation of the Roche assay using 73 
bronchoalveolar lavage or throat wash samples (not covered by the 
IFU) in participants with mixed symptom status (Figure 7); 42 of the 
73 samples were RT-PCR-positive (Schildgen 2020 [A]). 


Overall, using bronchoalveolar lavage or throat wash samples, the 
sensitivity and specificity were 88.1% (95% Cl 74.4% to 96.0%) and 
19.4% (95% Cl 7.5% to 37.5%) (73 samples, 42 cases; Table 3). Only 
the results for the subgroup of 50 throat wash samples could be 
separated by symptom status: 


¢ in symptomatic participants, sensitivity was 100% (95% Cl 
69.2% to 100%) and specificity was 7.7% (95% Cl 0.2% to 36.0%) 
with 23 throat wash samples and 10 cases; 


« in asymptomatic participants, sensitivity was 84.6% (95% Cl 
54.6% to 98.1%) and specificity was 14.3% (95% Cl 1.8% to 
42.8%), with 27 throat wash samples, 13 cases; Table 4). 


Savant Biotech - Huaketai SARS-CoV-2 N Protein 


We identified a single evaluation of the Huaketai assay in 109 
symptomatic participants, using combined naso- or oropharyngeal 
swabs in viral transport medium (Weitzel 2020 [C]; Figure 7). We 
could not obtain the manufacturer IFU. 


Sensitivity was 16.7% (95% Cl 9.2% to 26.8%) and specificity was 
100% (95% Cl 88.8% to 100%; 109 samples, 78 cases; Table 3; Table 
4). 


SD Biosensor - STANDARD F COVID-19 Ag 


We identified four evaluations of the STANDARD F assay; these 
reported data for 1552 samples, with 295 confirmed SARS-COV-2- 
positive cases (FIND 2020d (BR); FIND 2020d (DE); Liotti 2020; 
Porte 2020b [B]; Figure 6). Three evaluations included all or mainly 
symptomatic participants from community-based COVID-19 test 
centres and one was a laboratory-based study that did not provide 
details regarding symptom status. 


All evaluations tested nasopharyngeal or combined naso- 
or oropharyngeal samples, however only two complied with 
manufacturer IFU. Reasons for non-compliance were the use of viral 
transport medium, or lack of information concerning viral transport 
medium. 


The average sensitivity and specificity of the STANDARD F COVID-19 
Ag assay were: 


* 72.6% (95% Cl 54.0% to 85.7%) and 97.5% (95% Cl 96.4% to 
98.2%) overall (n = 4; 1552 samples, 295 cases; Table 3); 

* 78.0% (95% Cl 71.6% to 83.3%) and 97.2% (95% Cl 96.0% to 
98.1%) in symptomatic people (n = 3; 1193 samples, 191 cases; 
Table 4). 


No data for asymptomatic people were available. 


Restricting to IFU-compliant evaluations, average sensitivity and 
specificity were: 


© 75.5% (95% Cl 68.2% to 81.5%) and 97.2% (95% Cl 96.0 to 98.1%), 
both studies in symptomatic people (n = 2; 1129 samples, 159 
cases; Table 4). 


SD Biosensor - STANDARD Q COVID-19 Ag 


We identified six evaluations of the STANDARD Q assay; 
these reported data for 3480 samples, with 821 confirmed 
SARS-CoV-2-positive cases (Figure 6). Four evaluations included 
participants from community-based COVID-19 test centres, one 
was a laboratory-based study, and one included multiple 
settings. Four evaluations included symptomatic or mainly 
symptomatic participants, and two included mixed symptomatic 
and asymptomatic participants. 


All evaluations tested nasopharyngeal or combined naso- or 
oropharyngeal samples, four of which were compliant with 
manufacturer’s IFUs, the other two used samples in viral transport 
medium. 
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The average sensitivity and specificity of the STANDARD Q COVID-19 
Ag assay were: 


* 79.3% (95% Cl 69.6% to 86.6%) and 98.5% (95% Cl 97.9% to 
98.9%) overall (n = 6; 3480 samples, 821 cases; Table 3); 

* 80.1% (95% Cl 68.5% to 88.1%) and 98.1% (95% Cl 97.4% to 
98.6%) in symptomatic people (n = 5; 2760 samples, 731 cases); 
and 

* 61.1% (95% Cl 37.9% to 80.2%) and 99.6% (95% Cl 97.3% to 
99.9%) in asymptomatic people (n = 2; 272 samples, 18 cases; 
Table 4). 


Restricting to IFU-compliant evaluations, average sensitivities and 
specificities were: 


© 85.8% (95% Cl 80.5% to 89.8%) and 99.2% (95% Cl 98.2% to 
99.6%) overall (n = 4; 2522 samples, 421 cases; Table 3); 


* 88.1% (95% Cl 84.2% to 91.1%) and 99.1% (95% Cl 97.8% to 
99.6%) in symptomatic people (n = 3; 1947 samples, 336 cases); 
and 

* 69.2% (95% Cl 38.6% to 90.9%) and 99.1% (95% Cl 95.2% to 
100%) in asymptomatic people (n = 1; 127 samples, 13 cases; 
Table 4). 


Shenzhen Bioeasy Biotech - 2019-nCoV Ag 


We included three evaluations of the Bioeasy FIA; these included 
965 samples with 177 SARS-CoV-2-positive cases ((Kruger 2020(a); 
Porte 2020a; Weitzel 2020 [D]; Figure 6). Studies were conducted in 
hospital emergency departments (n = 2) or a community COVID-19 
test centre (n = 1). Participants in studies were all symptomatic or 
mainly symptomatic. 


Two evaluations used combined naso- or oropharyngeal swabs and 
one tested either nasopharyngeal or oropharyngeal swabs. Two 
evaluations used swabs in viral transport medium, which was not 
documented as suitable for use on the manufacturer IFU. 


The average sensitivity and specificity of the Shenzhen Bioeasy 
assay were : 


© 86.2% (95% Cl 72.4% to 93.7%) and 93.8 (95% Cl 91.9% to 95.3%) 
overall (all symptomatic; n = 3; 965 samples, 177 cases; Table 3; 
Table 4). 


The single IFU-compliant evaluation Kruger 2020(a) reported 
sensitivity of 66.7% (95% Cl 38.4% to 88.2%) and specificity of 
93.1% (95% Cl 91.0% to 94.9%; 727 samples, 15 cases). 


We also included an additional study that reported the 
development of this assay but we did not pool data with the other 
evaluations as it was a development and not a validation study 
(Diao 2020; Figure 7). Sensitivity was 67.8% (95% Cl 61.0% to 74.1%) 
and specificity was 100% (95% Cl 88.8% to 100%; 239 samples, 208 
cases). 


Direct test comparisons 


Three studies reported direct comparisons of different antigen 
assays in naso- or oropharyngeal samples; however none of the 
studies had any assay comparisons in common. All three studies 
utilised swabs in viral transport medium and all were conducted in 
symptomatic participants. We cannot derive any clear conclusions 
about comparative performance of tests from these studies. 


Figure 8 shows variable diagnostic performance between and to 
some extent within studies. Four of the five assays in Fourati 
2020 [A] demonstrated sensitivities in the range of 55% to 62% 
(SD Biosensor STANDARD Q, Abbott Panbio Covid-19 Ag, Biosynex 
COVID-19 Ag, AAZ - COVID-VIRO), with one outlier (Coris Bioconcept 
- Covid-19 Ag) at 35% (maximum of 297 cases). Specificity was 
100% for all assays apart from SD Biosensor SDQ (specificity 93%; 
337 pre-pandemic samples). 


In Porte 2020b [A] (32 cases) both assays had sensitivities over 90% 
(SD Biosensor STANDARD F and Quidel Sofia SARS Antigen), with 
specificities 97% (32 non-COVID-19 samples) 


Weitzel 2020 [A] observed a range in assay sensitivities from 0% 
for the Liming Bio-Products assay (based on only nine cases), to 
17% (for Savant Biotech - Huaketai SARS-CoV-2 N), 62% (RapiGEN - 
BIOCREDIT COVID-19 Ag) and 85% for Shenzhen Bioeasy Biotech - 
2019 nCov Ag (78 to 80 cases for the latter three assays). Specificities 
were 100% for all assays (based on 30 to 31 samples) apart from 
the one from Liming Bio-Products (specificity 90% based on 10 
samples). 


Accuracy of rapid molecular tests overall and by subgroup 


Average sensitivity and specificity for the 29 rapid molecular test 
evaluations that included samples with and without SARS-CoV-2, 
were 95.1% (95% Cl 90.5% to 97.6%) and 98.8% (95% Cl 98.3% to 
99.2%; 4351 samples, 1781 with confirmed SARS-CoV-2; Table 5). 
Adding the three 'cases only’ studies made little difference to the 
average sensitivity (95.5%, 95% Cl 91.5% to 97.7%; 1973 cases). 


Figure 9 demonstrates heterogeneity in sensitivity estimates 
(ranging from 57% to 100%), with consistently high specificities 
(92% to 100%, but with upper limits of 95% Cls of 99% or 100% in 
every study). 


Subgroup analyses by viral load 


We extracted sensitivity data according to viral load from 10 
evaluations of molecular tests, six of which reported data at a Ct 
threshold for higher viral load of 30 or less (Jokela 2020; Lieberman 
2020; Mitchell 2020; Smithgall 2020 [A]; Smithgall 2020 [B]; Wolters 
2020), four using Xpert Xpress and two using ID NOW. (Appendix 16) 


All sensitivity estimates for the higher viral load subgroups were 
100% (based on 204 samples with confirmed SARS-CoV-2), with a 
95% Cl for the average of 98.2% to 100%. For the lower viral load 
group, average sensitivity was 95.6% (95% Cl 55.7% to 99.7%) (149 
samples with confirmed SARS-CoV-2; Table 5). 


We observed a similar pattern for the studies using alternative Ct 
thresholds to define higher and lower viral load (Appendix 17). 


Subgroup analysis by study design 


We did not observe any clear differences in average sensitivity 
or specificity when studies were separated by study design (2899 
samples and 976 cases in 18 single-group studies and 1265 samples 
and 718 cases in nine two-group studies; Table 5; Appendix 17). 
Average sensitivity was higher in two-group studies (97.2%, 95% Cl 
90.7% to 99.2%) compared to single-group studies (93.2%, 95% Cl 
85.5% to 97.0%); a difference of 4.0 percentage points (95% Cl from 
2.2 percentage points lower to 10.1 higher). Average specificities 
had almost identical point estimates at 99.4% (95% Cl 98.4 to 
99.8%) and 99.3% (95% Cl 96.5% to 99.8%) respectively (Table 5). 
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Abbott - ID NOW 


Thirteen studies evaluated the ID NOW assay, with 1949 samples 
and 730 confirmed SARS-CoV-2 cases; one study included 
only SARS-CoV-2-positive cases (n = 36; Figure 10). Seven 
evaluations were laboratory-based, three recruited participants 
from emergency department settings and three were conducted 
in multiple settings. Seven studies included only symptomatic 
participants, two included both symptomatic and asymptomatic 
people, and four did not report symptom status. 


Eleven evaluations used nasopharyngeal or nasal swab samples, 
one was conducted using saliva samples and one did not specify 
the sample type. Only four evaluations were compliant with 
manufacturer IFUs; lack of compliance was based on the use of 
viral transport medium, sample type, and interval between sample 
collection and testing. 


Pooled analyses demonstrated average sensitivity and specificity 
of: 


* 78.6% (95% Cl 73.7% to 82.8%) and 99.8% (95% Cl 99.2% to 
99.9%) overall (n = 12; 1853 samples, 634 cases); and 


* 73.0% (95% Cl 66.8% to 78.4%) and 99.7% (95% Cl 98.7% to 
99.9%), restricted to evaluations that were compliant with the 
manufacturer’s IFU (n = 4; 812 samples, 222 cases; Table 5). 


Average sensitivity increased to 81.5% (95% Cl 75.2% to 86.5%), 
with the addition of the cases only study (730 cases; Rhoads 2020). 


Cepheid Inc - Xpert Xpress 


The Xpert Xpress assay was evaluated in 15 studies using 
respiratory specimens, with 1781 samples and 1001 confirmed 
SARS-CoV-2 cases; two of the studies included only SARS-CoV-2- 
positive cases (n = 90; Figure 10). Thirteen evaluations were 
laboratory-based, one recruited participants from emergency 
department settings and one included samples from hospital 
inpatients. Three studies included only symptomatic participants, 
one included both symptomatic and asymptomatic people (mixed 
symptom status), and 11 did not report symptom status. 


Fourteen evaluations used nasopharyngeal, oropharyngeal or 
nasal swab samples, and one was conducted using throat saliva or 
lower respiratory samples. Only three evaluations were compliant 
with manufacturer IFUs. Lack of compliance with the IFU was 
because of the use of frozen samples (n=8), or sample type (n= 1) or 
concerns about the timing between sample collection and testing 
(n=3). 


Pooled analyses demonstrated average sensitivity and specificity 
of: 


* 99.1% (95% Cl 97.7% to 99.7%) and 97.9% (95% Cl 94.6 % to 
99.2%) overall (n = 13; 1691 samples, 911 with confirmed SARS- 
CoV-2); 

* 100% (95% Cl 88.1% to 100%) and 97.2% (95% Cl 89.4%, 
99.3%), restricted to evaluations that were compliant with the 
manufacturer’s IFU (n = 2; 100 samples, 29 cases; Table 5) 


Average sensitivity did not change with addition of two cases-only 
studies (99.1%, 95% Cl 97.8% to 99.6%; n = 15; 730 cases; Broder 
2020; Chen 2020a). 


One additional study considered accuracy in non-respiratory 
samples using Xpert Xpress (Szymczak 2020). Sensitivity in stool 
samples obtained up to 33 days after symptom onset was 93.1% 
(95% Cl 77.2% to 99.1%) and specificity was 96.0% (95% Cl 86.3% 
to 99.5%; 79 samples, 29 cases). 


Comparison of ID NOW with Xpert Xpress 


Comparing the overall pooled results between ID NOW and Xpert 
Xpress, the average sensitivity of Xpert Xpress was 19.8 (95% Cl 14.9 
to 24.7) percentage points higher than that of ID NOW (P < 0.0001; 
Table 5). 


The average specificity of Xpert Xpress was marginally lower than 
that of ID NOW, a difference of -1.9 percentage points (95% Cl -3.8 
to -0.1). 


DNAnudge - COVID Nudge 


We included one evaluation of COVID Nudge with a total of 386 
participants and 71 SARS-CoV-2-positive cases (Gibani 2020; Figure 
10). Participants were recruited from multiple settings including 
hospital inpatients (n = 88), accident and emergency (n = 15) and 
healthcare workers and their families (n = 280). All participants were 
symptomatic and direct testing of nasopharyngeal samples was 
used (within manufacturer IFU). 


The sensitivity of the COVID Nudge assay was 94.4% (95% Cl 86.2 
to 98.4%) and specificity was 100% (95% Cl 98.8% to 100%; 386 
samples and 71 cases; Table 5). 


Diagnostics for the Real World (DRW) - SAMBA II 


We included two evaluations of SAMBA II with 321 samples 
(121 with confirmed SARS-CoV-2; Figure 10). All participants were 
symptomatic. One study conducted direct testing of combined 
naso- or oropharyngeal samples from hospital inpatients and the 
other obtained combined naso- or oropharyngeal samples in viral 
transport medium from Public Health England. It was not reported 
whether the PHE samples were stored or frozen prior to testing so 
we could not determine whether they complied with the IFU for the 
assay. 


The average sensitivity and specificity of SAMBA-II were 96.0% (95% 
Cl 81.1% to 99.3%) and 97.0% (95% Cl 93.5% to 98.6%; 2 studies; 
321 samples, 121 with confirmed SARS-CoV-2; Table 5). 


In the IFU-compliant evaluation, sensitivity was 87.9% (95% Cl 
71.8% to 96.6%) and specificity was 97.4% (95% Cl 92.6% to 99.5%; 
149 samples, 33 cases; Collier 2020; Table 5). 


Mesa Biotech - Accula 


We included one evaluation of the Accula assay with a total of 100 
samples (50 SARS-CoV-2 positive; Hogan 2020; Figure 10). The study 
was laboratory-based and symptom status was not reported. 


The study used nasopharyngeal samples in viral transport medium 
or saline, therefore the evaluation was not compliant with IFU 
requirements. 


The sensitivity and specificity of the Accula test were 68.0% (95% Cl 
53.3% to 80.5%) and 100% (95% Cl 92.9% to 100%; 100 samples, 50 
cases; Table 5). 
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Sensitivity analysis of the impact of discrepant analysis 


Six evaluations of molecular tests (in 1533 samples) reported 
results before and after discrepant analysis where selected samples 
were re-tested with either the same (Collier 2020; Harrington 
2020; Moran 2020; Stevens 2020), or an alternative RT-PCR assay 
(Assennato 2020; Loeffelholz 2020). Four studies also reported re- 
testing of samples with the index test (Assennato 2020; Collier 2020; 
Harrington 2020; Moran 2020; Appendix 16; Appendix 17). 


Discrepant analysis reduces the number of samples deemed to be 
false negative or false positive errors. Discrepant analysis reduced 
the false negative proportion (1-sensitivity) from 2.1% to 0.8% and 
the false positive rate (1-specificity) from 2.2% to 0.4%. Three of the 
five studies reporting initially false positive results reported zero 
false positives after sample re-testing and one reported a drop in 
false positives from 11 to 3 (Loeffelholz 2020; Appendix 16). Three 
of the four studies that reported re-testing of initially false negative 
results reported reclassification as true negative on re-testing, and 
in the other the single false negative remained as a false negative. 
Given the bias inherent in choosing the reference test dependent 
on the observed results, we caution against these findings. 


An additional study tested all samples with two different RT-PCR 
assays, and hence used a more accurate reference standard in all 
samples, not just samples with discrepant results (Moore 2020). 
Six initial true negatives were reclassified as false negatives after 
the second RT-PCR. Had discrepant analysis been undertaken these 
misclassifications would have been missed, further underlining the 
methodological flaws inherent to discrepant analysis. 


Other sources of heterogeneity 


We also planned to evaluate the effect of sample type and reference 
standard. 


For sample type, the use of variable combinations of sample types 
with or without viral transport media created numerous sparse 
subgroups by sample type (Appendix 18). Instead we considered 
study compliance with manufacturer IFU requirements which is a 
more pragmatic classification. 


All studies used RT-PCR alone as the reference standard for 
diagnosing SARS-CoV-2 infection. 


Publication bias 


We did not formally test for publication bias evident in the pattern 
of results, but did note that the identity of tests not meeting the 
PHE assessment criteria were not reported due to confidentiality 
agreements (PHE 2020(a)). 


DISCUSSION 


This is the second iteration of a Cochrane living review summarising 
the accuracy of point-of-care antigen and molecular tests for 
detecting current SARS-CoV-2 infection. This version of the review is 
based on published journal articles or studies available as preprints 
from 1 January 2020 up until 30 September 2020. In addition, we 
also included evaluations of antigen assays that were available 
as independent national reference laboratory publications or that 
were co-ordinated and published by FIND, and journal articles 
that were listed on the Diagnostics Global Health website to 16 
November 2020. 


Summary of main results 


We included data from 77 studies using respiratory specimens, 
including 24,418 samples (7484 samples with confirmed SARS- 
CoV-2), and one study of faecal specimens (79 samples, 29 with 
confirmed SARS-CoV-2). Forty-eight studies (reporting 58 test 
evaluations) considered antigen tests; 30 studies (reporting 33 test 
evaluations) considered rapid molecular tests, including the single 
study (evaluation) in faecal samples. Key findings are presented in 
the Summary of findings 1. 


We summarise six key findings from this review: 


1. Despite a considerable increase in the number of studies 
evaluating point-of-care tests, particularly antigen tests, there are 
still no published or preprint reports of accuracy for a significant 
number of commercially produced point-of-care tests. This review 
located evaluations for 16 antigen tests (three of which we could not 
identify as available for purchase) and five molecular assays. These 
represent a small proportion of assays currently on the market (118 
commercialised antigen tests and 53 molecular assays). 


2. The new studies have more robust and appropriate study designs 
compared to those in the first version of this review. Particularly for 
antigen tests where there are now studies recruiting participants 
from community-based COVID-19 testing clinics. Reporting of key 
details, such as settings and symptom status have improved, and 
studies are now evaluating direct swab testing as would occur 
in a point-of-care setting. However, concerns about risk of bias 
and applicability of results remain, and further improvements in 
study methods and reporting are needed before strong conclusions 
can be drawn about the accuracy of many antigen and molecular 
tests reviewed here. As it is not known whether these limitations 
will lead to over- or underestimates of test accuracy, estimates 
should be cautiously interpreted in context of their methodological 
limitations and the settings in which they were conducted. More 
direct comparisons of test brands are needed, with evaluations 
undertaken in the intended use settings for these tests. 


Particular methodological concerns include the use of deliberate 
sampling according to known presence or absence of SARS-CoV-2 
infection; use of anonymised samples submitted to laboratories 
for routine RT-PCR testing (with no setting or participant details); 
and no information on symptoms or time from symptom onset. 
Differences in case-mix related to symptomatic status, time post- 
symptom onset and distribution of viral load are likely to have 
contributed to the observed variation in accuracy. 


RT-PCR was the reference standard in all studies - no study defined 
the presence of COVID-19 using clinical or radiological features in 
the absence of a negative RT-PCR result. 


3. Studies frequently did not follow the manufacturer’s instructions 
or did not use the test at the point of care. Fewer than half 
conducted the tests according to the manufacturers' IFU (41% 
(37/91); 29/58 antigen test evaluations and 8/33 molecular test 
evaluations). Reasons for non-compliance included use of frozen 
samples, use of viral transport media, or lengthy intervals between 
sample collection and testing. Almost a third of studies (23/78) 
undertook on-site, direct swab testing immediately or within an 
hour of sample collection; trained laboratory staff conducted tests 
in 16 (21%) studies, and 31 (40%) studies did not clearly describe 
the test operator and setting for the test procedure but we inferred 
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that tests were carried out in a centralised laboratory setting, for 
example based on reported delays between collection and testing 
or reported use of archived or frozen samples. 


4. For antigen test evaluations in symptomatic participants, we 
observed considerable heterogeneity in sensitivities (and to a 
lesser extent the specificities). Whilst the average sensitivity was 
72.0% (95% Cl 63.7% to 79.0%) and specificity was 99.5% (95% 
Cl 98.5% to 99.8%), average sensitivity decreased with time since 
onset of symptoms, being higher in the first week (78.3%, 95% Cl 
71.1% to 84.1%) than when done later (51.0 95% Cl 40.8% to 61.0%). 
Sensitivity was high in those with higher viral loads defined by Ct 
values < 25 (94.5% 95% Cl 91.0% to 96.7%) compared to those 
with lower viral loads (40.7%, 95% Cl 31.8% to 50.3%). Focusing on 
studies that used the test in accordance with the manufacturer’s 
instructions, sensitivities for different brands varied from 34% 
to 96% (either based on pooled results or single studies). WHO 
have set a minimum ‘acceptable’ sensitivity requirement of 80%, 
and acceptable and ideal (or 'desirable') specificity requirements 
of 97% and 99% respectively (WHO 2020c). Only one assay (SD 
Biosensor STANDARD Q) met the WHO acceptable criterion for 
sensitivity based on pooled results of several studies. One further 
test (BIONOTE NowCheck) also met the acceptable sensitivity 
criterion, but only one study evaluated it. Abbott Panbio met 
the sensitivity criterion in individual studies but not overall. The 
acceptable performance criterion of 97% specificity was also met 
for all three tests, and two tests met the desirable criterion of more 
than 99% specificity (Abbott Panbio and SD Biosensor STANDARD 
Q). 


Considerable heterogeneity in sensitivities remained after 
restricting analyses by test brand and symptom status, suggesting 
an effect not only from participant characteristics but from 
setting, sample type and collection method, sample storage 
and preparation, and testing procedures that cannot be easily 
unpicked. The PHE studies included in this review allow some 
consideration of the effect of test operator experience on the 
accuracy of the Innova test although different samples were tested 
by each test operator such that only an indirect comparison of 
sensitivity can be made. Sensitivity increased from 57.5% (95% Cl 
52.3%, 62.6%; 372 samples) when testing was conducted on-site by 
trained non-healthcare workers (PHE 2020(c) [non-HCW tested]), to 
70.0% (95% Cl 63.5% to 75.9%; 223 samples) in samples tested on- 
site by healthcare workers ((PHE 2020(d) [HCW tested]), to 78.8% 
(95% Cl 72.4% to 84.3%; 198 samples) for those tested by laboratory 
scientists (PHE 2020(d) [Lab tested]). The effect of test operator 
on accuracy has been observed for rapid diagnostic tests for other 
infectious diseases such as malaria (Boyce 2018; Landier 2018), and 
is worthy of further investigation for diagnosis of SARS-CoV-2. 


5. Twelve studies evaluated the accuracy of antigen tests in 
asymptomatic people for detection of SARS-CoV-2 infection 
defined by PCR status. As discussed, this does not address the 
issue of whether the test is identifying those who are infectious 
(as there is no reference standard that can be used). The average 
sensitivity for detecting infection in asymptomatic participants was 
58.1% (95% Cl 40.2% to 74.1%) with specificity of 98.9% (95% Cl 
93.6% to 99.8%), both lower than in symptomatic people. Only 
half of studies reported clearly defined asymptomatic cohorts (e.g. 
preventive screening in the general population (n = 1), in returning 
travellers (n = 1), or in contacts of confirmed cases (n = 4)), the 
other six reported asymptomatic subgroups from mixed symptom 


cohorts. Only one of the 12 studies provided data by viral load 
(Fenollar 2020(b)); 5% (1/22) of RT-PCR-positive samples had a Ct 
value of 25 or less, but 50% (11/22) had Ct values of 30 or less. No 
information on time after exposure to infection was reported. 


6. For rapid molecular assays there were differences between test 
brands. Most data were for ID NOW and Xpert Xpress assays; average 
sensitivity for ID NOW was 78.6% (95% Cl 73.7% to 82.8%) and Xpert 
Xpress 99.1% (95% Cl 97.7% to 99.7%). Specificity for ID NOW was 
99.8% (95% Cl 99.23%, 99.9%) and Xpert Xpress 97.9% (95% Cl 
94.6% to 99.2%). These differences are beyond those expected by 
chance (P <0.0001). 


We were not able to investigate the effects of symptomatic status, 
or time from symptom onset: 12/29 were from symptomatic 
populations, three from ‘mixed’ symptomatic and asymptomatic 
populations (percentage from each group not reported), and the 
remaining 14 evaluations provided no information on symptom 
status (2/14 recruited from A&E and 12 were laboratory-based). 
These and other methodological limitations in the studies mean 
that we do not know how the assays would perform in any 
specific clinical setting when used in people suspected of having 
SARS-CoV-2 infection on the basis of symptoms, or of exposure 
to a confirmed case in the absence of symptoms. It is likely 
however that some difference in sensitivity between ID NOW and 
Xpert Xpress would be maintained in the absence of bias. The 
difference in specificity between the tests is small (ID NOW being 
1.9% more specific compared to Xpert Xpress), but potentially 
important especially if used in a low-prevalence setting. However, 
this difference in specificity would not be an issue should test- 
positives be confirmed by a laboratory-based RT-PCR assay. 


7. There are proposals for repeated use of antigen tests in different 
asymptomatic groups, such as school children and staff, hospital 
and care home workers, and even the general public, with a 
variety of different testing strategies. We found no data or studies 
evaluating the accuracy of any of these serial screening strategies. 


We did not formally compare antigen with molecular assays 
because there were no head-to-head comparisons of the two test 
types. Instead, we illustrate predicted numbers of true positives, 
false positives, false negatives and true negatives, applying 
summary estimates of test accuracy to a hypothetical cohort 
of people suspected of SARS-CoV-2 infection across a range in 
prevalence of SARS-CoV-2 infection (Summary of findings 1). For 
both antigen and molecular assays, we only use summary data 
from evaluations conducted in accordance with manufacturers’ 
IFUs, and for antigen tests we used separate results from 
symptomatic and asymptomatic participants. 


Illustration of predicted effect of antigen testing by symptom 
status 


For antigen test evaluations in symptomatic people, we selected 
three assays representing the range in observed average 
sensitivities: Coris Bioconcept COVID-19 Ag Respi-Strip (34.1% to 
95% Cl 29.7% to 38.8%), Abbott - Panbio Covid-19 Ag (75.1% to 95% 
Cl 57.3% to 87.1%); and SD Biosensor - STANDARD Q COVID-19 Ag 
(88.1% to 95% Cl 84.2% to 91.1%). Average specificities for the same 
three assays were 100% (95% Cl 99.0% to 100%) to 99.5% (95% Cl 
98.7% to 99.8%) and 99.1% (95% Cl 97.8% to 99.6%) respectively. 
Applied to a cohort of 1000 people with signs and symptoms of 
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COVID-19, in whom 50 people had confirmed infection (prevalence 
of 5%), for the three assays above we predicted that: 


* 17,43 or 53 people would have a positive test result, of which 0, 
5 and 9 would be false positives (positive predictive values (PPV) 
100%, 88.4% and 83.0%, respectively), and 


* 33,12 and 6 people with negative test results would be falsely 
negative (negative predictive values (NPV) 96.6%, 98.7%, and 
99.4%). 


Increasing the prevalence to 10% or 20%, increases PPV and 
decreases NPV. As there is considerable heterogeneity in the 
estimates of sensitivity, the values observed in practice could vary 
considerably from these figures as shown by the estimates derived 
from the confidence intervals (Summary of findings 1). 


For antigen test evaluations in asymptomatic participants 
there was considerably less available data from IFU-compliant 
evaluations. We selected the same three exemplars, average 
sensitivities for identification of any infection (whether infectious 
or not) were lower than for symptomatic populations: 28.6% (95% 
Cl 8.4% to 58.1%) for the Coris Bioconcept assay; 48.9% (95% Cl 
35.1% to 62.9%) for the Abbott assay; and 69.2% (95% Cl 38.6% 
to 90.9%) for the SD Biosensor assay. Average specificities for the 
same three assays were: 100% (95% Cl 88.8% to 100%), 98.1% (95% 
Cl 96.3% to 99.1%), and 99.1% (95% Cl 95.2% to 100%). 


Applying the average values to a larger cohort of 10,000 people 
asymptomatic for COVID-19 and with a lower prevalence of 0.5% in 
whom 50 people had confirmed infection (infectious or not): 


¢ 14, 213 or 125 individuals would have a positive test result of 
which 0, 189 and 90 would be false positives (PPVs of 100%, 11% 
and 28%, respectively), and 

* 36, 26 and 15 people with negative test results would be falsely 
negative (NPVs 99.6%, 99.7%, and 99.8%). 


We derived the summary estimates used in these calculations from 
asymptomatic participants identified for testing in a number of 
scenarios and they cannot be directly translated to a particular 
setting, such as mass screening, for example. The confidence 
intervals for the average estimates used in these calculations are 
also extremely wide for both sensitivities and specificities, such 
that the numbers of false positives and false negatives observed in 
practice could differ substantially from these figures. Increasing the 
prevalence of confirmed SARS-CoV-2 infection to 1% or 2% makes 
little difference to the absolute number of false positive results 
for these assays, but has a large relative effect when considered 
in relation to the number of positive test results (PPVs for the 
Abbott and SD Biosensor assays increasing to 40% and 61% at 2% 
prevalence). 


Illustration of predicted effect of rapid molecular tests for 
symptomatic testing 


For molecular assays, data from IFU-compliant evaluations were 
available for four of the five assays: ID NOW (Abbott Laboratories), 
Xpert Xpress (Cepheid Inc), SAMBA II (Diagnostics for the Real 
World) and COVID Nudge (DNAnudge). Average sensitivities were 
derived as 73.0% (95% Cl 66.8% to 78.4%), 100% (95% Cl 88.1% to 
100%), 87.9% (95% Cl 71.8% to 96.6%) and 94.4% (95% CI 86.2% to 
98.4%). Average specificities were 99.7% (95% Cl 98.7% to 99.9%), 


97.2% (95% C1 89.4% to 99.3%), 97.4% (95% Cl 92.6% to 99.5%) and 
100% (95% Cl 98.8% to 100%), respectively (Summary of findings 1). 


Data by symptom status for these assays were very limited, 
therefore we assumed that the intended use is most likely to be for 
diagnosis of acute infection in symptomatic individuals and have 
applied the average estimates of accuracy to a hypothetical cohort 
of 1000 people, at prevalences of 5%, 10% and 20% (Summary 
of findings 1). If 50 of 1000 people had confirmed infection (5% 
prevalence): 


« 40, 77, 69 and 47 individuals would have a positive test result 
of which 3, 27, 25 or 0 would be false positive (PPVs of 93.0%, 
64.9%, 63.8%, and 100% respectively). 

« 14,0, 6 and 3 people with negative test results would be falsely 
negative (NPVs 98.6%, 100%, 99.4% and 99.7%). 


Increasing the prevalence of confirmed SARS-CoV-2 infection to 
10% or 20% has a large relative effect when considered in relation to 
the number of positive test results for both Xpert Xpress and SAMBA 
Il (PPVs were 64.9% and 63.8% at 5% prevalence compared to 90.1% 
and 89.3% at 20% prevalence). Less variation in PPV was observed 
for ID NOW and COVID-Nudge because of the higher observed 
specificities. The NPV for the molecular assays is not affected 
to the same degree by these prevalence changes because of 
their relatively high sensitivities and the relatively low-prevalence 
scenarios being considered. 


Across all exemplar assays in the Summary of findings 1, we 
observed the widest variation in NPV for the Coris Bioconcept 
antigen assay in symptomatic participants (86% to 97%), 
demonstrating that even in a low-prevalence setting, tests with 
poor sensitivity can have a considerable impact on the level of 
confidence that can be had in a negative test result. 


Strengths and weaknesses of the review 


Our review used a broad search screening all articles concerning 
COVID-19 or SARS-CoV-2. We undertook all screening and eligibility 
assessments, QUADAS-2 assessments (Whiting 2011), and data 
extraction of study findings independently and in duplicate. 
Although it is possible that the use of artificial intelligence text 
analysis to identify studies most relevant to diagnostic questions 
may have led to some eligible studies being missed, we believe 
that the multi-stranded search strategy used will have identified 
most if not all relevant literature. Whilst we have reasonable 
confidence in the completeness and accuracy of the findings up 
until the search date, should errors be noted please inform us at 
coviddta@contacts.bham.ac.uk so that we can verify and correct in 
our next update. 


We undertook a careful assessment of sample preparation and 
biosafety requirements as well as time to test result, to ensure 
that included tests were suitable for use at the point of care. 
The application of these index test criteria led to the exclusion 
of 39 of the 85 studies that we excluded on the basis of the 
index tests evaluated. Evaluations of alternative laboratory-based 
molecular technologies are under consideration for inclusion in 
another review in our series of Cochrane COVID-19 diagnostic test 
accuracy reviews. Furthermore, for this iteration of the review, we 
explicitly considered whether the test evaluations were conducted 
in accordance with the manufacturer IFU, regarding the sample 
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types used, the use of viral transport medium and the permitted 
time between sample collection and testing. 


We did not consider any manufacturer statements on the intended 
use of the tests by population, but we are aware that some IFUs 
recommend testing only in symptomatic people and within certain 
time frames after symptom onset (e.g. the Innova assay). Where 
possible, however, we did provide data separately for symptomatic 
and asymptomatic participants and identified clear trends towards 
lower sensitivities in asymptomatic individuals for detection of 
infection. We were unable to assess the accuracy of antigen tests 
for identification of infectious individuals, as there is no established 
reference standard for infectiousness (and it seems unlikely that 
one will ever be established). We have presented results by Ct 
value where it has been reported by the individual studies. We 
recognise the limitations from this approach, and given the extent 
to which RT-PCR Ct values vary between assays (Vogels 2020), 
and between laboratories, we strongly caution against the direct 
application of our results in high and low Ct value subgroups 
to any particular clinical context. There is no 'step change' in 
‘infectiousness' according to any fixed Ct value; increasing numbers 
of studies demonstrate successful viral culture in individuals 
considered to have ‘low' viral load (Jaafar 2020; Singanayagam 
2020), and, more importantly, that transmission of infection does 
occur from index cases with low RT-PCR Ct values (Lee 2021; Marks 
2021). Ultimately, viral load on its own is only one factor influencing 
an individual's ability to transmit infection, 'infectiousness' being 
modified by host factors such as the health of an individual’s 
immune system or presence of comorbidities, and environmental 
risk factors including closeness and length of contact with others. 


Weaknesses of the review primarily reflect the weaknesses in 
the primary studies and their reporting. Although study quality 
improved in comparison to the first iteration of this review, many 
studies continue to omit descriptions of participants, and key 
aspects of study design and execution. In order to include data 
for all tests in pooled analyses we had to include some samples 
multiple times. We have been explicit about these issues where 
they arose. It is possible that eligible studies have been missed 
by our search strategy however we believe the risk to be very 
low considering our broad approach to identification of literature. 
Despite our best efforts to be as comprehensive as possible, 
new evaluations are continuously becoming available and it is 
impossible for any published and peer-reviewed systematic review 
to be fully up to date. 


Around a quarter (18/78) of the studies we have included are 
currently only available as preprints, and as yet, have not 
undergone peer review. As published versions of these studies are 
identified in the future, we will double-check study descriptions, 
methods and findings, and update the review as required. 


Applicability of findings to the review question 


There are an increasing number of roles and testing strategies for 
which antigen and rapid molecular assays are considered, and it is 
likely that the performance of these tests needs to be considered 
separately for each of the use cases. 


Our review shows that antigen tests do not appear to perform 
as well in asymptomatic populations compared to symptomatic 
populations for detecting infection. The amount of available data 
for asymptomatic populations is less than that from symptomatic 


populations and is also based on asymptomatic individuals 
tested in a range of scenarios, from preventive or targeted 
screening, to contact tracing or testing at dedicated COVID-19 test 
centres, which may explain some of the observed variability. It 
is also not clear whether individuals in these studies were truly 
cases of asymptomatic infection as opposed to pre- or post- 
symptomatic, or were even mildly symptomatic and mislabelled 
as asymptomatic. Incomplete symptom assessment and lack 
of adequate follow-up to identify subsequent development of 
symptoms or previous history of symptoms can all contribute 
to inappropriate classification of individuals as asymptomatic 
infection (Meyerowitz 2020). As the studies in our review did 
not systematically attempt to identify pre- or post-symptomatic 
individuals, it may be more appropriate to consider the estimates 
for test accuracy for asymptomatic populations as primarily 
representing accuracy in those without clearly defined symptoms 
at the time of testing. 


We are aware that several important studies in asymptomatic 
individuals have been reported since the close of our search. In 
mass screening in Liverpool, Innova was positive in 28 of 70 PCR- 
detected cases (sensitivity for infection 40.0%, 95% Cl 28.5% to 
52.4%) and 26 of 39 with Ct values less than 25 (sensitivity 66.7%, 
95% Cl 49.8% to 80.9%). Screening University of Birmingham 
students found 2 of 7185 students positive with Innova, and 
estimated sensitivity of 3.2% (95% Cl 0.6% to 15.6%) for detecting 
any infection, 9.1% (95% Cl 1.0% to 49.1%) for Ct values less than 
30 and 100% (95% Cl 15.8% to 100%) for Ct less than 25 (Ferguson 
2020). BinaxNOW (which uses the same test strip as PanBio) has 
been tested in asymptomatic groups: in San Francisco the test 
detected 7 of 11 PCR-positive cases (sensitivity 63.6%, 95% Cl 30.8% 
to 89.1%), and 6 of 6 with Ct values less than 30 (100%, 95% 
Cl 54.1% to 100%; Pilarowski 2021); in a drive-through centre in 
Massachusetts it detected the virus in 70 of 107 in adults (sensitivity 
65.4%, 95% CI 55.6 to 74.4) and 40 of 57 in children (70.2%, 95% Cl 
56.6% to 81.6%)); no breakdown by viral load is available (Pollock 
2020). The specificity of the tests in all studies has remained high 
(above 99%). This selection of results is not based on a systematic 
search (this will occur in the next update) but these results suggest 
that emerging evidence is illustrating a range of sensitivity values 
for the ability of the tests to detect infection, with high detection 
rates only in groups with very high viral loads. 


Given the superior test performance characteristics for 
symptomatic populations in the first week of symptoms and in 
those with higher viral loads, the observed poorer performance 
in those without symptoms is perhaps not surprising. Evidence 
suggests that higher viral loads are observed in the first week of 
illness, beginning two days prior to the development of symptoms 
(Cevik 2021). Viral load patterns in asymptomatic people are less 
clear but similarly high titers of SARS-CoV-2 have been observed at 
the onset of infection with a suggestion of faster clearance (Cevik 
2021). However, variation in viral trajectories means that even if an 
asymptomatic person can identify a clear contact with a confirmed 
case of SARS-CoV-2 infection, it is not possible to pinpoint when 
(or even if) that individual will have a sufficient viral load to be 
detected on antigen testing. A serial testing policy would be likely to 
identify at least some infected asymptomatic contacts, but comes 
at the cost of increased numbers of false positives, especially in low- 
prevalence settings. There were no evaluations of serial testing in 
any of the studies. 
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For molecular tests, we observed a lack of studies undertaken 
in intended use settings, with most data being from laboratory 
testing. Although more evidence is available for accuracy in 
symptomatic people, applicability issues regarding the way in 
which the tests are carried out and in how cases of SARS-CoV-2 
infection are defined remain, and it is not yet possible to determine 
how tests will perform in practice. 


We recommend caution in applying the results outside of the 
individual study (or closely related) contexts and use case 
scenarios. 


AUTHORS' CONCLUSIONS 


Implications for practice 


We consider the implications for practice for this review separately 
for symptomatic and for asymptomatic testing. 


In the Role of index test(s) section, we suggested that for 
symptomatic individuals, and if sufficiently accurate, point-of-care 
testing could be used either to replace laboratory-based RT-PCR or 
as a triage to RT-PCR. As point-of-care tests are more accessible and 
provide a result more quickly than RT-PCR, theoretically their use 
may increase detection and speed up isolation and contact-tracing, 
leading to reduction in disease spread and reduce the burden on 
laboratory services. 


The evidence included to date suggests that: 


1. For diagnosis in symptomatic individuals in the first few days 
of symptoms, the most accurate rapid antigen tests are a useful 
alternative to laboratory-based RT-PCR where immediate results 
are required for timely patient management or where there are 
significant logistical or financial challenges in delivering RT-PCR in 
a timely manner. Rapid antigen tests are only sufficiently sensitive 
in the first week since onset of symptoms. 


Antigen tests vary in sensitivity, and only those shown to meet 
appropriate criteria, such as WHO's priority target product profiles 
for COVID-19 diagnostics (i.e. sensitivity > 80% and specificity = 
97%; WHO 2020c), could be considered as a rational substitute for 
RT-PCR. 


Tests had high specificity, thus in symptomatic populations (where 
prevalence is likely to be high) the risk of false positives is low. At 
80% sensitivity compared to RT-PCR, the probability that infected 
individuals are missed is 20% higher than for RT-PCR. Thus the 
possibility of false negative results should be considered in those 
with a high clinical suspicion of COVID-19, particularly if tested 
several days after onset of symptoms when viral load levels may 
have fallen. 


2. Rapid antigen tests may be used simultaneously in combination 
with RT-PCR for symptomatic people, particularly where RT-PCR 
turn-around times are slow, to exploit the benefits of earlier results 
and consequent contact-tracing and isolation. Given the risk of 
false-negative results, isolation may be required until RT-PCR- 
negative results are obtained. Similarly, for investigation of local 
outbreaks, rapid antigen testing in a clearly defined population may 
establish cases and contacts that require isolation whilst awaiting 
results from RT-PCR. 


In other circumstances rapid antigen tests may be used to 
triage to follow-on RT-PCR tests (rather than all receiving PCR 
tests) dependent on prevalence and the consideration of the 
consequences of false positive and false negative results. 


Where prevalence is low, positive rapid test results require 
confirmatory testing to avoid unnecessary quarantine measures 
(PPVs around 85% to 90% for antigen assays mean that between 1 
in 10 and 1in7 positive results will be falsely positive). If unverified, 
negative rapid test results should be delivered with appropriate 
advice on self-isolation procedures for the duration of symptoms 
in order to minimise the effect on transmission of infection from 
missed cases. RT-PCR tests should still be considered for people 
with a high clinical suspicion of COVID-19 and negative rapid test.. 


Where prevalence is higher (i.e. 20% or higher), false positives are 
less of a concern (PPVs are 96% to 100%) but the impact from 
false negative results becomes increasingly important and all test 
negatives may be considered for verification. At 20% prevalence, 
and using data for the more sensitive of our three exemplar assays, 
between 3% and 6% of those with negative rapid test results are 
missed cases of SARS-CoV-2 (24 to 50 cases missed out of a total 
of 200 cases). The lower the NPV the greater the potential effect on 
transmission of infection from missed cases and greater the impact 
from delays in commencement of contact tracing. For scenarios 
in which positive results do not have confirmatory testing, it is 
important that assays with high specificities (in the range of 99% 
to 100%) are selected in order to minimise the impact from false 
positive results at higher prevalences of disease. 


3. We identified virtually no evidence for mass screening of 
asymptomatic individuals using rapid antigen tests in people with 
no known exposure. A small study screening travellers returning 
from high-risk countries (Cerutti 2020), identified only five SARS- 
CoV-2 infections (prevalence of 3%) with a reported sensitivity of 
antigen testing for detecting infection of 40%. However, important 
larger studies have been published since the end of our search, as 
mentioned above. 


The key focus in mass screening is identification of individuals 
who are or will become infectious. PCR-positives define those who 
had detectable viral particles on their swab, which will include 
most of those who are or will become infectious, but also include 
individuals post-infection with residual viral particles. Without a 
reference standard for infectiousness, test accuracy studies cannot 
assess the ability of the test to detect the infectious subgroup 
of infections, and cannot provide evidence as to how well rapid 
antigen tests differentiate between individuals requiring isolation 
and those who provide no risk. The effectiveness of mass screening 
using these tests will only be established though outcome studies, 
such as cluster-randomised community trials. 


Given the low false positive rate of rapid tests, when used in a 
period of outbreak, those found testing positive will have a high 
chance of being true positives, and thus the test can be used to 
identify cases requiring isolation. Consideration should be made as 
to whether test positives should be confirmed with PCR to identify 
false positives. With a 1% prevalence, a test with 40% sensitivity 
and 99.6% specificity would yield as many false positives as true 
positives. 


However, the low and variable sensitivity, and lack of evidence that 
those who test negative are not, or will not become, infectious 
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indicates that those who are rapid antigen test-negative cannot be 
considered free of risk of being, or of becoming, infectious. In any 
screening or mass testing programme people testing negative may 
still have a non-negligible risk of infection. 


4. We did not find any evidence of test accuracy in at-risk 
asymptomatic groups, such as contacts of confirmed cases, 
hospital workers, or during local outbreaks at schools, workplaces, 
or care homes. The impact of low-sensitivity tests in these settings 
is greater than in mass screening, as there will be higher numbers 
of false negatives, which could either create new outbreaks or will 
increase the severity of existing outbreaks. Positive cases will be 
more likely to be true positives than in mass screening settings. 


5. We did not find any evidence evaluating the repeated use of tests. 
Although serial testing (over a number of days), or combinations 
of different rapid tests (e.g. an antigen test followed by a rapid 
molecular test) on the same sample are proposed to overcome the 
limitations of low test sensitivity, they all require validation. Use 
of multiple tests may increase false positive results, and there are 
likely to be many individuals with repeated false negative results 
reducing the expected benefit of subsequent tests. It is unlikely that 
models will be able to predict how well repeated tests and test 
combinations would work. 


6. Some rapid molecular tests showed promising accuracy levels 
approximating those of laboratory-based RT-PCR and thus may 
have a role in small-capacity settings where obtaining test results 
within two hours will enable appropriate decision making. Results 
for Xpert Xpress, COVID Nudge and SAMBA II all showed high 
sensitivity and specificity. However, we identified methodological 
concerns with many of the evaluations such that we cannot be 
certain as to how the tests will perform when used in a point-of-care 
setting. Any application in practice should be accompanied with a 
proper evaluation to ascertain performance in real-world settings. 
Rapid molecular tests do not have all the logistical advantage of 
rapid antigen tests and the resource implications of their use at 
scale are potentially high, but they may be well suited for some 
testing scenarios. There is no evidence for use of rapid molecular 
tests in asymptomatic populations. 


Our conclusions are in line with those in the first version of 
this review despite the increase in the evidence base. Ultimately, 
decisions around rapid testing will be driven not only by diagnostic 
accuracy but by acceptable levels of test complexity, time to result, 
access and acceptability to those being tested, and how test results 
influence individual behaviour, all of which might vary according to 
the setting in which the tests are to be used. 


Implications for research 


There is now a considerable volume of research for point-of-care 
tests for SARS-CoV-2 infection. However further well designed 
prospective and comparative evaluations of individual tests and 
test strategies in clinically relevant settings are urgently needed. 
Studies should recruit consecutive series of eligible participants 
and should clearly describe the clinical status, document time from 
symptom onset or time since exposure. Point-of-care tests must 
be conducted in accordance with manufacturer instructions for 
use, and across the spectrum of point-of care settings and test 
operators. 


There needs to be evaluations of both individual tests and 
strategies of use of repeated tests. For molecular assays field 
trials are needed, not only to demonstrate test accuracy in these 
groups but acceptability and ease of use outside of centralised 
laboratories. 


We observed a number of studies of molecular assays employing 
discrepant analysis to confirm the disease status of samples with 
false positive results in particular. There is a considerable risk 
of this type of selective re-testing leading to distorted results. If 
there is sufficient concern about the reliability of a single RT-PCR 
test then all samples should be tested with two RT-PCR assays. 
Finally, any future research study needs to be clear about eligibility 
and exclusion decisions throughout the whole diagnostic pathway, 
and should conform to the updated Standards for Reporting of 
Diagnostic Accuracy (STARD) guideline (Bossuyt 2015). 


Consideration needs to be made of the best method for evaluating 
mass screening programmes. Whilst test accuracy studies help 
indicate which tests are likely to detect the greatest numbers of 
cases with the fewest false positives, assessing whether detecting 
asymptomatic cases leads to worthwhile reductions in disease 
spread will only be properly answered by studies of impact not 
accuracy. 
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* Indicates the major publication for the study 


CHARACTERISTICS OF STUDIES 


Characteristics of included studies /ordered by study ID] 


Albert 2020 


Study characteristics 


Patient Sampling Single group study estimating sensitivity and specificity: 
Patients with clinical suspicion of COVID-19 (compatible signs or symptoms 
appearing within the prior week) attending one of 8 primary care centres 
(n=412) 


Recruitment: Not stated; likely consecutive 


Prospective or retrospective: Prospective 


Patient characteristics and setting Setting: Primary care 


Location: 8 primary care centres of the Health Department Clinico-Malvarrosa 
in Valencia. 


Country: Spain 

Dates: Sep 2nd to Oct 7 2020 

Symptoms and severity: All symptomatic (<7 days p.s.o) 
Demographics: median age, 31 y (range, 1-91); 42% male 
327 adults; median, 36 y (17-91y) 

85 children; median, 11 y (1-16y) 


Exposure history: Not stated 


Index tests Test name: Panbio™ COVID-19 AG Rapid Test Device (no product code report- 
ed) 


Manufacturer: Abbott Diagnostic GmbH, Jena, Germany 

Antibody: Nucleoprotein 

Antigen target: Not stated 

Test method: Not stated 

Samples used: NP; collected by trained nurses using flocked swabs 
Transport media: None for Ag testing 

Sample storage: None 


Test operator: Not stated; immediate testing 
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Albert 2020 (continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Definition of test positivity: Visible line within 15 mins; As per manufacturer 
Blinding reported: Yes 


Timing of samples: Day <7 pso 


Reference standard: RT-PCR; TaqPath COVID-19 Combo Kit (Thermo Fisher Sci- 
entific, Massachusetts, USA) 


Definition of non-COVID cases: As for cases; single negative 
Genetic target(s): ORFlab, N and S genes 

Samples used: NP in UTM 

Timing of reference standard: As for index; tested within 24h 
Blinded to index test: Not stated; presume Yes 


Incorporated index test: No 


Time interval between index and reference tests: Simultaneous; paired 
All patients received same reference standard: Yes 

Missing data: None reported; no participant flow diagram reported 
Uninterpretable results: None reported 

Indeterminate results (index test): None reported 

Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 


Funding: This work received no public or private funds. Abbott Diagnostics 
provided Panbio™ COVID-19 AG Rapid Test Device kits. 


Publication status: Pre-print 
Source: medRxiv 


Author COI: The authors declare no conflicts of interest 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
Was a consecutive or random sample of patients Yes 
enrolled? 
Was a case-control design avoided? Yes 
Did the study avoid inappropriate exclusions? Yes 
Did the study avoid inappropriate inclusions? Yes 
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Albert 2020 (continued) 


Could the selection of patients have introduced 
bias? 


Are there concerns that the included patients 
and setting do not match the review question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test results interpreted without 
knowledge of the results of the reference standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the index 
test have introduced bias? 


Are there concerns that the index test, its con- 
duct, or interpretation differ from the review 
question? 


DOMAIN 2: Index Test (Rapid molecular tests) 
DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly classi- 
fy the target condition? 


Were the reference standard results interpreted 
without knowledge of the results of the index tests? 


Reference standard does not incorporate result of 
index test? 


Could the reference standard, its conduct, or its 
interpretation have introduced bias? 


Are there concerns that the target condition 
as defined by the reference standard does not 
match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between index 
test and reference standard? 


Did all patients receive the same reference stan- 
dard? 


Were all patients included in the analysis? 
Did all participants receive a reference standard? 
Were results presented per patient? 


Could the patient flow have introduced bias? 


Low risk 


Yes 


Yes 


Low risk 


No 


Yes 


Yes 


High risk 


Yes 


Yes 


Unclear 
Yes 
Yes 


Unclear risk 


Low concern 


Unclear 


High 
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Alemany 2020 








Study characteristics 

Patient Sampling Single group study including particpants from three settings: 
[1] symptomatic individuals with suspected COVID-19 seen in routine practice (n=446) 
[2] contacts exposed to positive PCR confirmed COVID-19 cases (n=473) 
[3] preventive screening of unexposed asymptomatic individuals in the general popula- 
tion (n=487) 
Recruitment: Retrospective (frozen swabs) 
Prospective or retrospective: Not stated 

Patient characteristics and setting Setting: Mixed/Unclear (laboratory-based) 
Location: Not reported; multiple author institutions reported 
Country: Spain 
Dates: Not stated 
Symptoms and severity: Not stated; 15/1406 (1.1%) reportedly hospitalised (all PCR+) 
Viral load of cases: Ct <20: 258 (18.3%); Ct 20-24 305 (21.7%); Ct 25-29 285 (30.3%); Ct >30 
103 (7.3%) 
Demographics: All samples: mean age 40.4y (SD 24.5), 453 (32.2% male) 
Exposure history: 473/1406 (33.6%) identified through contact tracing; 

Index tests Test name: Panbio™ COVID-19 Ag Test (no product codes) [Selected following valida- 
tion exercise using 40 NP samples to compare PanBio with Coris Bioconcept COVID-19 
Ag RespiStrip, SD Biosensor Standard F COVID-19 Ag FIA and Standard Q COVID-19 Ag 
Test] 
Manufacturer: Abbott Laboratories, Illinois, USA 
Antibody: Not stated 
Antigen target: SARS-CoV-2 
Test method: CGIA 
Samples used: [1] and [2] NP, [3] nasal mid-turbinate; collection not reported 
Transport media: VTM (DeltaSwab Virus) 
Sample storage: stored at 2-8C prior to PCR then frozen (-80C) prior to Ag testing; 
"Internal validation showed no significant change in the test performance using Abbot 
test Kit buffer or a mix of the Kit buffer and transport media at 1:3 dilution; likewise, the 
use of frozen specimens showed no significant differences compared with fresh ones" 
Test operator: two laboratory technicians 
Definition of test positivity: Visible line; as per manufacturer 
Blinding reported: Yes 
Timing of samples: Not stated 

Target condition and reference stan- Reference standard: RT-PCR; in-house following CDC protocol 

dard(s) 
Definition of non-COVID cases: As per cases; single negative PCR for absence of infection 
Genetic target(s): Not stated; as per CDC protocol 
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Alemany 2020 (continued) 


Flow and timing 


Comparative 


Notes 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of 
patients enrolled? 


Was a case-control design avoided? 


Did the study avoid inappropriate exclu- 
sions? 


Did the study avoid inappropriate inclu- 
sions? 


Could the selection of patients have in- 
troduced bias? 


Are there concerns that the included 
patients and setting do not match the 


review question? 


DOMAIN 2: Index Test (Antigen tests) 


Samples used: NP or nasal mid-turbinate; as per index test 


Timing of reference standard: fresh samples stored at 2 - 8 °C for up to 72 hours prior to 
RT-PCR 


Blinded to index test: Yes; conducted first 


Incorporated index test: No 


Time interval between index and reference tests: Simultaneous (same swab) 
All patients received same reference standard: Yes 

Missing data: None reported; no participant flow diagram reported 
Uninterpretable results: None reported 

Indeterminate results (index test): None reported 

Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 


Funding: The test kits were purchased to Abbott Rapid Diagnostics Healthcare SL 
(Spain). The funders of the study had no role in the study conception, design, conduct, 
data analysis, or writing of the report. 


Publication status: Pre-print 
Source: medRxiv 


Author COI: Authors declare no conflicts of interest 


Authors' judgement Risk of bias Applicability concerns 


Unclear 


Yes 


Yes 


Yes 


Unclear risk 


High 
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Were the index test results interpreted Yes 
without knowledge of the results of the 
reference standard? 


If a threshold was used, was it pre-speci- Yes 
fied? 


Could the conduct or interpretation of Low risk 
the index test have introduced bias? 


Are there concerns that the index test, High 
its conduct, or interpretation differ 

from the review question? 

DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to cor- No 
rectly classify the target condition? 


Were the reference standard results inter- Yes 
preted without knowledge of the results 
of the index tests? 


Reference standard does not incorporate Yes 
result of index test? 


Could the reference standard, its con- High risk 

duct, or its interpretation have intro- 

duced bias? 

Are there concerns that the target con- High 
dition as defined by the reference stan- 

dard does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval be- Yes 
tween index test and reference standard? 


Did all patients receive the same refer- Yes 
ence standard? 


Were all patients included in the analysis? Unclear 





Did all participants receive a reference Yes 
standard? 
Were results presented per patient? Yes 
Could the patient flow have introduced Unclear risk 
bias? 
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Assennato 2020 








Study characteristics 
Patient Sampling Single-group study to estimate sensitivity and specificity: 
- samples from symptomatic individuals with suspected COVID-19 sent for routine labo- 
ratory diagnosis; supplied via PHE (n = 172) 
Recruitment: not stated 
Prospective or retrospective: retrospective 
Number of samples (samples with confirmed SARS-CoV-2): 172 (88) 
Patient characteristics and setting Setting: not stated; supplied by PHE 
Location: PHE, Cambridge Laboratory (samples from East of England) 
Country: UK 
Dates: not stated 
Symptoms and severity: symptomatic; no further details 
Demographics: not stated 
Exposure history: not stated 
Index tests Test name: SAMBA II SARS-CoV-2 Test 
Manufacturer: Diagnostics for the Real World 
Antigen target: ORFlab, N2 
Antibody: N/A 
Test method: rapid PCR 
Samples used: combined nose and throat swab samples, provided as VTM 
Transport media: samples diluted 1:2 with SAMBA SCoV buffer 
Sample storage: not stated 
Test operator: not stated; presume laboratory staff 
Definition of test positivity: as per manufacturer; either target present 
Blinding reported: yes; states that samples were rendered anonymous and provided 
blinded for the purpose of test validation 
Timing of samples: not stated 
Target condition and reference stan- Reference standard: RT-PCR; (1) Cambridge RdRp gene (Wuhan) assay on the Rotor gene 
dard(s) Q real-time PCR assay routinely used by PHE; Ct s 36 considered positive. (2) Samples al- 
so tested with the PHE Colindale (Reference Laboratory) assay 
Definition of non-COVID cases: Single RT-PCR negative 
Genetic target(s): (1) RdRp, E gene, (2) RdRp ‘different region' 
Samples used: combined nose and throat swab in VTM; same as for index test 
Timing of reference standard: not stated; Cambridge assay seems to have been part of 
routine testing near to time of sample collection; not clear if Colindale assay was at a 
later date after a period of storage 
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Assennato 2020 (continued) 


Flow and timing 


Comparative 


Notes 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of 
patients enrolled? 


Was a case-control design avoided? 


Did the study avoid inappropriate exclu- 
sions? 


Did the study avoid inappropriate inclu- 
sions? 


Could the selection of patients have in- 
troduced bias? 


Are there concerns that the included 
patients and setting do not match the 


review question? 


DOMAIN 2: Index Test (Antigen tests) 


Blinded to index test: not stated but seems yes for Cambridge assay 


Incorporated index test: no 


Time interval between index and reference tests: not stated; seems likely reference was 
carried out for routine diagnostic testing 


All participants received same reference standard: yes (all samples underwent both RT- 
PCR tests) 


Missing data: none reported, no participant flow diagram reported 
Uninterpretable results: none reported 


Indeterminate results (index test): 3 FP and 1 FN result retested using SAMBA-II; same re- 
sults obtained on repeat 


Indeterminate results (reference standard): 3 FP and 1 FN result were re-tested 

- all 3 FPS found to be borderline positive for = 1 target gene on either Colindale or Cam- 
bridge (Wuhan) test (reclassified as TP) 

- the FN result remained positive on both RT-PCR assays 


Unit of analysis: refers to participants rather than samples 


Funding: RKG is funded by Wellcome Senior Fellowship In Clinical Science award no 
WT108082AIA 


Publication status: preprint 
Source: medRxiv 


Author COI: no COI statement reported; 3 co-authors are affiliated to test manufacturer 


Authors' judgement Risk of bias Applicability concerns 


Unclear 


Yes 


Unclear 


Unclear 


Unclear risk 


Unclear 
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Assennato 2020 (continued) 


DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test results interpreted 
without knowledge of the results of the 
reference standard? 


If a threshold was used, was it pre-speci- 
fied? 


Could the conduct or interpretation of 
the index test have introduced bias? 


Are there concerns that the index test, 
its conduct, or interpretation differ 
from the review question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to cor- 
rectly classify the target condition? 


Were the reference standard results inter- 
preted without knowledge of the results 


of the index tests? 


Reference standard does not incorporate 
result of index test? 


Could the reference standard, its con- 
duct, or its interpretation have intro- 
duced bias? 

Are there concerns that the target con- 
dition as defined by the reference stan- 
dard does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval be- 
tween index test and reference standard? 


Did all patients receive the same refer- 
ence standard? 


Were all patients included in the analysis? 


Did all participants receive a reference 
standard? 


Were results presented per patient? 


Could the patient flow have introduced 
bias? 


Yes 


Yes 


Low risk 


No 


Yes 


Yes 


High risk 


Yes 


Yes 


Unclear 


Yes 


Yes 


Unclear risk 


Unclear 


High 
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Billaud 2020 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Index tests 


Target condition and reference standard(s) 


Single group study to estimate sensitivity and specificity: 


- teachers (n=90) and students (n=419) screened for COVID-19 as part of a 
cluster investigation (n=509) 


Recruitment: Not stated; appears to be open to all 


Prospective or retrospective: Prospective 


Setting: Screening 
Location: College, Lyon 
Country: France 

Dates: September 16 and 17 


Symptoms and severity: 166/509, 32.6% symptomatic including 152/419 
(36%) students 


Demographics: Mean, median age 
Students 21.6y, 21y (18 to 37y) 
Teachers 47.2y, 49y (26 to 64y) 


Exposure history: Outbreak investigation 


Test name: Described as "ABBOTT SARS-COV2 Antigenic Test"; presumed 
to be Panbio COVID-19 Ag Test 


Manufacturer: Abbott 

Antibody: Not stated 

Antigen target: Not stated 

Test method: Not stated 

Samples used: NP; collected by firefighters 

Transport media: None used 

Sample storage: n/a; tested immediately on site 

Test operator: Not stated 

Definition of test positivity: Visual line; as per manufacturer 
Blinding reported: Yes, performed first 


Timing of samples: Not stated but includes people >7 days pso 


Reference standard: RT-PCR; SARS-COV-2 (Thermofisher) 
Definition of non-COVID cases: As for cases; single negative 
Genetic target(s): Not stated 

Samples used: NP (paired) 

Timing of reference standard: As for index 


Blinded to index test: Not stated 
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Incorporated index test: No 


Flow and timing Time interval between index and reference tests: Simultaneous 
All patients received same reference standard: Yes 
Missing data: 47 missing, including 11 uninterpretable 
Uninterpretable results: 11 uninterpretable on Ag test 
Indeterminate results (index test): None reported 
Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 
Comparative 


Notes Funding: Not stated, public funding 
Publication status: Published 
Source: Report accessed via SFM Microbiologie website 
Author COI: None 


Methodological quality 


Item Authors' judgement Risk of bias Applicability con- 
cerns 


DOMAIN 1: Patient Selection 


Was a consecutive or random sample of patients en- Yes 

rolled? 

Was a case-control design avoided? Yes 

Did the study avoid inappropriate exclusions? Yes 

Did the study avoid inappropriate inclusions? Yes 

Could the selection of patients have introduced Low risk 

bias? 

Are there concerns that the included patients and Low concern 


setting do not match the review question? 
DOMAIN 2: Index Test (Antigen tests) 


Were the index test results interpreted without knowl- Yes 
edge of the results of the reference standard? 


If a threshold was used, was it pre-specified? Yes 


Could the conduct or interpretation of the index test Low risk 
have introduced bias? 


Are there concerns that the index test, its conduct, Unclear 
or interpretation differ from the review question? 
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Billaud 2020 (continued) 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly classify the No 


target condition? 


Were the reference standard results interpreted with- Unclear 
out knowledge of the results of the index tests? 


Reference standard does not incorporate result of in- Yes 


dex test? 


Could the reference standard, its conduct, or its in- High risk 


terpretation have introduced bias? 


Are there concerns that the target condition as de- High 
fined by the reference standard does not match the 


question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between index test Yes 


and reference standard? 


Did all patients receive the same reference standard? Yes 
Were all patients included in the analysis? No 
Did all participants receive a reference standard? Yes 
Were results presented per patient? Yes 
Could the patient flow have introduced bias? High risk 


Blairon 2020 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Single group study to estimate sensitivity and specificity: sampled from cohort of sus- 
pected COVID-19 patient samples sent for laboratory diagnosis (n=56) 

[Excluded data for full cohort, as only those with negative antigen test underwent con- 
firmatory RT-PCR; of 912 submitted samples during time period, 776 remained after re- 
moving repeat tests and were reported in main study] 


Recruitment: Selection of 56 for verification analysis was not reported. 


Prospective or retrospective: prospectively 


Setting: Unclear; swabs obtained at hospital site (no further detail) 
Location: Not stated; author institution Iris Hospitals South, Brussels 
Country: Belgium 


Dates: April 5 - May 4 2020 
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Blairon 2020 (continued) 


Index tests 


Target condition and reference standard(s) 


Flow and timing 


Symptoms and severity: Not stated 
Demographics: Not stated 


Exposure history: Not stated 


Test name: COVID-19 Ag Respi-Strip (no product code reported) 
Manufacturer: Coris Bioconcept (Gembloux, Belgium) 
Antibody: Not stated 

Antigen target: Not stated 

Test method: LFA 

Samples used: NP swabs; collection not reported 


Transport media: Samples for antigen testing taken from UTM-RT swabs (Copan spa, 
Brescia, IT) 


Sample storage: No storage described; infer that antigen test was conducted immedi- 
ately on receipt of sample at on-site laboratory ‘after antigenic testing was performed, 
the molecular assessment of SARS-CoV-2 was outsourced to a university centre’ 


Test operator: Not stated; infer laboratory staff 
Definition of test positivity: As per manufacturer 
Blinding reported: Not stated; infer yes as conducted prior to PCR confirmation 


Timing of samples: Not stated; appears to be on presentation (repeat tests ordered at 
clinician's discretion were excluded) 


Reference standard: qRT-PCR 


Definition of non-COVID cases: As above, single PCR negative to confirm absence of 
disease 


Genetic target(s): E gene 

Samples used: NP swabs (same as for Ag test) 
Timing of reference standard: Not stated 
Blinded to index test: Not stated 


Incorporated index test: No 


Time interval between index and reference tests: Not stated but infer short interval; 
samples sent to university centre laboratory for PCR confirmation 


All patients received same reference standard: Yes (only if author confirms Ag+ also got 
PCR) 


Missing data: None reported; review team excluded main cohort data as no reference 
standard for antigen test positive samples 


Uninterpretable results: None reported; 1 'invalid' sample excluded from main cohort 


Indeterminate results (index test): None reported; 1 'non-conform' sample excluded 
from main cohort 


Indeterminate results (reference standard): None reported 
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Blairon 2020 (continued) 


Comparative 


Notes 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of 
patients enrolled? 


Was a case-control design avoided? 


Did the study avoid inappropriate exclu- 
sions? 


Did the study avoid inappropriate inclu- 
sions? 


Could the selection of patients have in- 
troduced bias? 


Are there concerns that the included pa- 
tients and setting do not match the re- 
view question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test results interpreted 
without knowledge of the results of the ref- 
erence standard? 


If a threshold was used, was it pre-speci- 
fied? 


Could the conduct or interpretation of 
the index test have introduced bias? 


Are there concerns that the index test, 
its conduct, or interpretation differ from 
the review question? 


Unit of analysis: Unclear; main cohort includes unique patient samples but not report- 
ed for separate group of 56 


Funding: None to declare 
Publication status: Published 
Source: Journal of Clinical Virology 


Author COI: None to declare 


Authors' judgement Risk of bias Applicability concerns 


Unclear 


Yes 


Yes 


Yes 


Unclear risk 


Unclear 


Yes 


Yes 


Low risk 


Unclear 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 
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Blairon 2020 (continued) 


Is the reference standards likely to correct- 
ly classify the target condition? 


Were the reference standard results inter- 
preted without knowledge of the results of 


the index tests? 


Reference standard does not incorporate 
result of index test? 


Could the reference standard, its con- 
duct, or its interpretation have intro- 
duced bias? 


Are there concerns that the target con- 
dition as defined by the reference stan- 
dard does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between 
index test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Did all participants receive a reference 
standard? 


Were results presented per patient? 


Could the patient flow have introduced 
bias? 


Broder 2020 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


No 


Unclear 


Yes 


High risk 


High 


Yes 


Yes 


No 


Yes 


Unclear 


High risk 


Single-group study to estimate sensitivity: 
- samples positive on Roche cobas 6800 assay in lower range of viral load (E tar- 
get Ct = 30) (n= 35) 


Recruitment: not stated; deliberate sampling according to viral load 
Prospective or retrospective: unclear 


Number of samples (samples with confirmed SARS-CoV-2): 35 (35) 


Setting: not stated 


Location: not stated; author institution Emory University School of Medicine, At- 
lanta 


Country: USA 
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Broder 2020 (continued) 





Dates: not stated 
Symptoms and severity: not stated; lower viral load 
Demographics: not stated 


Exposure history: not stated 


Index tests Test name: GeneXpert Xpress SARS-CoV-2 assay (no product code reported) 
Manufacturer: Cepheid 
Antigen target: not stated E gene 
Antibody: N/A 
Test method: rapid PCR 
Samples used: NP swabs in VTM 
Transport media: not stated 
Sample storage: within 3 days of initial testing (with RT-PCR) 
Test operator: not stated; presume laboratory staff 


Definition of test positivity: “all specimens were tested using the manufacturer’s 
protocol”, no mention of presumptive positives 


Blinding reported: not stated 


Timing of samples: not stated 


Target condition and reference standard(s) Reference standard: Roche cobas 6800 SARS-CoV-2 assay 
Definition of non-COVID cases: N/A 
Genetic target(s): E gene (unclear if other genetic targets as well) 
Samples used: NP swabs (as for index test) 
Timing of reference standard: not stated; presume on presentation 
Blinded to index test: not stated; presume yes 


Incorporated index test: no 


Flow and timing Time interval between index and reference tests: same samples; index within 3 
days of reference 


All participants received same reference standard: yes 

Missing data: none reported 

Uninterpretable results: none reported, no participant flow diagram reported 
Indeterminate results (index test): none reported 


Indeterminate results (reference standard): discrepancies resolved using modi- 
fied CDC RT-PCR; 1 FN confirmed as disease negative (i.e. a TN) 


Unit of analysis: not stated; refers only to samples 
Comparative 


Notes Funding: no funding described 
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Broder 2020 (continued) 





Publication status: accepted manuscript 
Source: Journal of Clinical Microbiology 


Author COI: Dr. Kraft participated on a Roche advisory board regarding COVID 
serology. All other study authors have no conflicts 


Methodological quality 
Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of patients No 
enrolled? 


Was a case-control design avoided? No 
Did the study avoid inappropriate exclusions? Unclear 
Did the study avoid inappropriate inclusions? Unclear 


Could the selection of patients have introduced High risk 
bias? 


Are there concerns that the included patients High 
and setting do not match the review question? 


DOMAIN 2: Index Test (Antigen tests) 


DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test results interpreted without Unclear 

knowledge of the results of the reference stan- 

dard? 

If a threshold was used, was it pre-specified? Yes 

Could the conduct or interpretation of the in- Unclear risk 


dex test have introduced bias? 


Are there concerns that the index test, its con- Unclear 
duct, or interpretation differ from the review 
question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly clas- Yes 
sify the target condition? 


Were the reference standard results interpret- Unclear 
ed without knowledge of the results of the index 
tests? 


Reference standard does not incorporate result of Yes 
index test? 
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Broder 2020 (continued) 


Could the reference standard, its conduct, or 
its interpretation have introduced bias? 


Are there concerns that the target condition 
as defined by the reference standard does not 
match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between index 
test and reference standard? 


Did all patients receive the same reference stan- 
dard? 


Were all patients included in the analysis? 
Did all participants receive a reference standard? 
Were results presented per patient? 


Could the patient flow have introduced bias? 


Cerutti 2020 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Index tests 


Unclear risk 
High 

Yes 
Yes 
Unclear 
Yes 
Unclear 

Unclear risk 


Single group study to estimate sensitivity and specificity in two cohorts: 

(1) symptomatic patients attending one of two Emergency departments (n=185) 
(2) asymptomatic travellers returning home from European high risk countries 
(Croatia, Spain, Malta) (n=145) 


Recruitment: (1) Random; (2) Not stated, presume consecutive 


Prospective or retrospective: Not stated 


Setting: Mixed; (1) Emergency department; (2) Possible contacts 


Location: (1) two Infectious Disease reference centres in North-Italy (ASL Citt® a di 
Torino, Turin and San Martino University Hospital, Genoa); (2) Not stated; samples 
sent to Microbiology and Virology Laboratory, Amedeo di Savoia Hospital, Torino 


Country: Italy 
Dates: (1) Mar 3 to May 1; (2) August 2020 
Symptoms and severity: Not stated; cohort (2) were asymptomatic 


Demographics: (1) mean age 44.6, 95 %CI: 40.7-48.6; (2) mean age 35.9, 95 % Cl: 
32.7-39.1 


Exposure history: (1) Not stated; (2) High risk country visit 


Test name: STANDARD Q COVID-19 Ag 
Manufacturer: SD-Biosensor, RELAB, | 


Antibody: NP 
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Cerutti 2020 (continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Item 


Antigen target: Not stated 

Test method: Not stated 

Samples used: NP; collection not stated 
Transport media: UTM (Copan, |) 


Sample storage: Primarily run in parallel with standard of care RT-PCR; 13 were 
frozen residual samples 


Test operator: Not stated; laboratory staff presumed 
Definition of test positivity: Visual line after 15-30 mins; as per manufacturer. 
Blinding reported: Not stated 


Timing of samples: Not stated 


Reference standard: RT-PCR; Seegene Allplex® 2019 n-CoV Assay (N = 159), DiaSorin 
Simplexa® (n = 28), and Cobas 6800 Roche® (N = 118). 


Definition of non-COVID cases: Single negative 
Genetic target(s): Not stated 

Samples used: Not stated 

Timing of reference standard: Not stated 
Blinded to index test: Unclear 


Incorporated index test: No 


Time interval between index and reference tests: Simultaneous; not clear if same 
sample used or paired swabs obtained 


All patients received same reference standard: Yes; different assays 
Missing data: None reported; no participant flow diagram reported 
Uninterpretable results: None reported 

Indeterminate results (index test): None reported 

Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 


Funding: Authors thank RELAb for the donation of the STANDARD Q COVID-19 SD- 
Biosensor kits to pursue the study. No other specific grant from public funding agen- 
cies was received. 


Publication status: Published 
Source: J Clin Virol 


Author COI: The authors report no declarations of interest. 


Authors' judgement Risk of bias Applicability concerns 
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Cerutti 2020 (continued) 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of pa- Yes 
tients enrolled? 


Was a case-control design avoided? Yes 
Did the study avoid inappropriate exclusions? Yes 
Did the study avoid inappropriate inclusions? Yes 


Could the selection of patients have intro- Low risk 
duced bias? 


Are there concerns that the included pa- Low concern 
tients and setting do not match the review 

question? 

DOMAIN 2: Index Test (Antigen tests) 

Were the index test results interpreted with- Unclear 

out knowledge of the results of the reference 

standard? 


If a threshold was used, was it pre-specified? Yes 


Could the conduct or interpretation of the Unclear risk 
index test have introduced bias? 


Are there concerns that the index test, its High 
conduct, or interpretation differ from the 

review question? 

DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly No 
classify the target condition? 


Were the reference standard results interpret- | Unclear 
ed without knowledge of the results of the in- 
dex tests? 


Reference standard does not incorporate re- Yes 
sult of index test? 


Could the reference standard, its conduct, High risk 
or its interpretation have introduced bias? 


Are there concerns that the target condi- High 
tion as defined by the reference standard 


does not match the question? 


DOMAIN 4: Flow and Timing 
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Cerutti 2020 (continued) 


Was there an appropriate interval betweenin- Yes 


dex test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Did all participants receive a reference stan- 
dard? 


Were results presented per patient? 


Could the patient flow have introduced 
bias? 


Chen 2020a 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Yes 


Unclear 


Yes 


Yes 


Unclear risk 


Single group study using: 

- archived paired samples from COVID-19 inpatients (n=58). Aim is to compare diagnos- 
tic yield between saliva and NP swabs but can also extract sensitivity for each using 
rapid test. 


Recruitment: Not stated 


Prospective or retrospective: Retrospective 


Setting: In-patients 

Location: Queen Mary Hospital, Pokfulam, Hong Kong 
Country: People’s Republic of China 

Dates: Not stated 

Symptoms and severity: Not stated 

Demographics: Median age 38 y; 28, 48% male 


Exposure history: Not stated 





Index tests Test name: Xpert Xpress SARS-CoV-2 assay (no product codes reported) 

Manufacturer: Cepheid, Sunnyvale, CA, USA 
Target gene(s): E and N2 gene 
Antigen target: n/a 
Test method: Automated RT-PCR 
Samples used: NP, saliva (posterior oropharyngeal, self-collected by clearing the throat 
and spitting cl mL saliva directly into a sterile bottle in the early morning before mouth 
rinsing and breakfast) 
Transport media: Both sample types immersed in 2ml of viral transport solution 
Sample storage: Not stated; archived 
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Chen 2020a (continued) 





Test operator: Not stated; infer laboratory staff 


Definition of test positivity: Not stated; tested 'according to manufacturer’s instruction’ - 
no mention of presumptive positives 


Blinding reported: Not stated; 


Timing of samples: Not stated 


Target condition and reference stan- Reference standard: in-house SARS-CoV-2 RNA dependent RNA polymerase/ Helicase 
dard(s) (RdRp/Hel) real-time 
RT-PCR assay 


Definition of non-COVID cases: n/a only cases included 
Genetic target(s): RdRp 

Samples used: same as index test 

Timing of reference standard: Not stated; prior to index test 
Blinded to index test: Not stated; infer yes 


Incorporated index test: No 


Flow and timing Time interval between index and reference tests: Simultaneous; same samples 
All patients received same reference standard: Yes 


Missing data: None reported, no participant flow diagram reported. THree samples posi- 
tive only on saliva excluded by review team 


Uninterpretable results: Not stated 
Indeterminate results (index test): Not stated 
Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 
Comparative 


Notes Funding: This study was partly supported by Consultancy Services for Enhancing Lab- 
oratory Surveillance of Emerging Infectious Diseases and Research Capability on An- 
timicrobial Resistance, and the Theme-Based Research Scheme (T11/707/15) of the Re- 
search Grants Council, the donations of Richard Yu and Carol Yu, the Shaw Foundation 
Hong Kong Michael Seak-Kan Tong, May Tam Mak Mei Yin Respiratory Viral Research 
Foundation Limited, Hui Ming, Hui Hoy, and Chow Sin Lan Charity Fund Limited, Chan 
Yin Chuen Memorial Charitable Foundation, Marina Man-Wai Lee, the Jessie & George Ho 
Charitable Foundation, Perfect Shape Medical Limited, and Kai Chong Tong. 


Publication status: Published 
Source: Emerging microbes and infections 


Author COI: No potential conflict of interest was reported by the author(s); Xpert Xpress 
cartridges provided by the test manufacturer via an Investigator-Initiated Study agree- 
ment (Cepheid-IIS-2020-0009). 


Methodological quality 


Item Authors' judgement Risk of bias Applicability concerns 
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Chen 2020a (continued) 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of 
patients enrolled? 


Was a case-control design avoided? 


Did the study avoid inappropriate exclu- 
sions? 


Did the study avoid inappropriate inclu- 
sions? 


Could the selection of patients have in- 
troduced bias? 


Are there concerns that the included 
patients and setting do not match the 


review question? 


DOMAIN 2: Index Test (Antigen tests) 


Unclear 


No 


Unclear 


Unclear 


DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test results interpreted 
without knowledge of the results of the 
reference standard? 


If a threshold was used, was it pre-speci- 
fied? 


Could the conduct or interpretation of 
the index test have introduced bias? 


Are there concerns that the index test, 
its conduct, or interpretation differ 
from the review question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to cor- 
rectly classify the target condition? 


Were the reference standard results inter- 
preted without knowledge of the results 
of the index tests? 


Reference standard does not incorporate 
result of index test? 


Could the reference standard, its con- 
duct, or its interpretation have intro- 
duced bias? 


Are there concerns that the target con- 
dition as defined by the reference stan- 
dard does not match the question? 


Unclear 


Unclear 


Yes 


Yes 


Yes 


High risk 


Unclear risk 


Low risk 


High 


High 


High 
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Chen 2020a (continued) 
DOMAIN 4: Flow and Timing 


Was there an appropriate interval be- Yes 
tween index test and reference standard? 
Did all patients receive the same refer- Yes 


ence standard? 


Were all patients included in the analysis? Unclear 


Did all participants receive a reference Yes 

standard? 

Were results presented per patient? Yes 

Could the patient flow have introduced Unclear risk 


bias? 


Collier 2020 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Index tests 


Single group study to estimate sensitivity and specificity: suspected COVID-19 patients admit- 
ted with a possible diagnosis of COVID-19 (n=149) 


Recruitment: Consecutive 


Prospective or retrospective: prospectively 


Setting: In-patients 

Location: Cambridge University Hospitals NHS Foundation Trust 
Country: UK 

Dates: April 6 - May 2 2020 

Symptoms and severity: Not stated 

Demographics: Mean age 62.7 y, 70, 47% male 


Exposure history: Not stated 


Test name: SAMBA II SARS-CoV-2 test (no product code reported) 

Manufacturer: Diagnostics for the Real World (DRW), University of Cambridge, Cambridge 
Target gene(s): Orfl and the E genes 

Antigen target: n/a 

Test method: RT-PCR 

Samples used: combined nasal/throat swab (NOP) on dry sterile swab. Collection not reported 
Transport media: None used; samples inactivated in SCov buffer prior to testing 

Sample storage: Not stated. Test performed within 18 hours of reference test 


Test operator: Not stated; infer laboratory staff 
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Collier 2020 (continued) 


Target condition and reference 
standard(s) 


Flow and timing 


Comparative 


Notes 


Definition of test positivity: As per manufacturer 


Blinding reported: Unclear; yes if always conducted before reference test but not explicitly de- 
scribed, i.e. 'SAMBA swab must be taken within 18 hours of the standard laboratory swab' 


Timing of samples: Not stated; appears to be on presentation/admission but no further details 


Reference standard: RT-PCR; in-house PHE assay 
Definition of non-COVID cases: As above, single PCR negative to confirm absence of disease 
Genetic target(s): Not stated 


Samples used: Not stated; separate swab used as participants were excluded if >18h interval 
between swab collections 


Timing of reference standard: Not stated 


Blinded to index test: Yes; 'The results of the SAMBA II SARS-CoV-2 was not known to the asses- 
sors of the standard lab RT-PCR prior.’ 
Not stated. Possibly if done prior to index test. 


Incorporated index test: No 


Time interval between index and reference tests: <18 hours 
All patients received same reference standard: Yes 


Missing data: Yes; 5 discarded VTM, 1 timing of PHE swab not reported, 1 inadequate SAMBA 
swab, 2 interval between swabs >24h 


Uninterpretable results: None reported 


Indeterminate results (index test): Not stated 

‘Indeterminate SAMBA II SARS CoV-2 tests were repeated with a 1:2 dilution of sample to inacti- 
vation buffer according to manufacturer standard operating procedures until a valid result was 
obtained.’ 

Discrepant results between index and reference were also re-tested using SAMBA-II on original 
samples 


Indeterminate results (reference standard): 1 false negative 

Indeterminate standard lab RT PCR tests were repeated on a replicate nose/throat swab until a 
valid result was obtained. 

Discrepant results between index and reference were re-tested using RT-PCR on original sam- 
ples, with reference to clinical notes to determine clinical suspicion. Remaining discrepant re- 
sults were re-tested using alternative sample, i.e. sample in SCov buffer tested on RT-PCR and 
sample in VTM tested on SAMBA-II 


Unit of analysis: Patients 


Funding: The Wellcome Trust (Senior Research Fellowship to RKG WT108082AIA and PhD Re- 
search Fellowship to DAC; Principal Research Fellowship 210688/Z/18/Z to PJL), Addenbrooke’s 
Charitable Trust to PJL, National Institute of Health Research (NIHR) Cambridge BRC 


Publication status: Pre-print and published version (25-8-20) 
Source: Pre-print; Cell Reports Medicine 


Author COI: Pre-print - Dr. Besser reports personal fees from STAGO, personal fees from Novar- 
tis, personal fees from Cosmopharma, personal fees from Werfen, personal fees from Agios, 
grants from Mitsubishi Pharma, outside the submitted work; RKG reports fees from ad hoc con- 
sulting from ViiV, Gilead and UMOVIS. 
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Collier 2020 (continued) 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sam- 
ple of patients enrolled? 


Was a case-control design avoid- 
ed? 


Did the study avoid inappropriate 
exclusions? 


Did the study avoid inappropriate 
inclusions? 


Could the selection of patients 
have introduced bias? 


Are there concerns that the in- 
cluded patients and setting do 
not match the review question? 


Published version - The authors declare no competing interests (Three co-authors affiliated to 


test manufacturer) 


Authors' judgement 


Yes 


Yes 


Yes 


Yes 


DOMAIN 2: Index Test (Antigen tests) 


DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test results inter- 
preted without knowledge of the 
results of the reference standard? 


If a threshold was used, was it pre- 
specified? 


Could the conduct or interpreta- 
tion of the index test have intro- 
duced bias? 


Are there concerns that the in- 
dex test, its conduct, or inter- 
pretation differ from the review 
question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to 
correctly classify the target condi- 
tion? 


Were the reference standard re- 
sults interpreted without knowl- 
edge of the results of the index 
tests? 


Unclear 


Yes 


No 


Yes 


Risk of bias Applicability concerns 


Low risk 


Low concern 


Unclear risk 


Unclear 
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Collier 2020 (continued) 





Reference standard does not in- Yes 

corporate result of index test? 

Could the reference standard, High risk 

its conduct, or its interpretation 

have introduced bias? 

Are there concerns that the tar- High 

get condition as defined by the 

reference standard does not 

match the question? 

DOMAIN 4: Flow and Timing 

Was there an appropriate interval No 

between index test and reference 

standard? 

Did all patients receive the same Yes 

reference standard? 

Were all patients included in the No 

analysis? 

Did all participants receive arefer- Yes 

ence standard? 

Were results presented per pa- Yes 

tient? 

Could the patient flow have in- High risk 

troduced bias? 

Courtellemont 2020 

Study characteristics 

Patient Sampling Unclear design estimating sensitivity and specificity (coded as two group because of 
deliberate sampling of PCR positive cases): 
(1) Symptomatic (headache, fatigue, fever, or respiratory signs) or asymptomatic 
people voluntarily accessing the COVID-19 Screening Department (n=231) 
(2) hospitalized SARS-CoV-2 positive patients (n=17) 
[review team excluded 20 cases with a previous positive RT-qPCR within 5 days but a 
negative RTqPCR at the time of study sampling] 
Recruitment: Unclear 
Prospective or retrospective: Unclear 

Patient characteristics and setting Setting: Mixed 
Location: COVID-19 Screening Department and SARS CoV-2 positive patients hos- 
pitalized in the Infectious Diseases Department of the Centre Hospitalier Régional 
(CHR) of Orléans, France, or the Department of Infectious and Tropical Diseases of 
the Centre Hospitalier Universitaire (CHU) Tenon, Paris 
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Courtellemont 2020 (continued) 


Index tests 


Target condition and reference standard(s) 


Flow and timing 


Country: France 

Dates: Oct 12 to Oct 19 

Symptoms and severity: 99/121, 82% cases were symptomatic; 22 asymptomatic 
Demographics: median age 38y, mean age 43y (range: 18-96), 117, 47% male 


Exposure history: Not stated 


Test name: COVID-VIRO® 

Manufacturer: AAZ, Boulogne Billancourt, France 
Antibody: Nucleocapsid 

Antigen target: monoclonal 

Test method: CGIA 


Samples used: NP; collected by trained personnel (nurse, doctors, or biologist); sub- 
group also had OP or saliva collected 


Transport media: Direct testing for Ag test 

Sample storage: None 

Test operator: Not stated 

Definition of test positivity: Visible line; As per manufacturer 
Blinding reported: Yes 


Timing of samples: median 5 days pso, mean 5.3 days, range 1 to 20d 


Reference standard: RT-PCR; TaqPath Covid-19 Multiplex RT-PCR, Thermofisher 
Definition of non-COVID cases: single negative PCR 

Genetic target(s): ORFlab, S and N genes 

Samples used: NP in VTM; paired 

Timing of reference standard: As for index 

Blinded to index test: Not stated 


Incorporated index test: No 


Time interval between index and reference tests: Simultaneous; paired 
All patients received same reference standard: Yes 


Missing data: None reported, no participant flow diagram reported; review team 
excluded 20 cases with a previous positive RT-qPCR within 5 days but a negative 
RTqPCR at the time of study sampling 


Uninterpretable results: None reported 
Indeterminate results (index test): None reported 
Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 
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Courtellemont 2020 (continued) 





Comparative 


Notes Funding: No funding statement reported 
Publication status: Preprint 
Source: medRxiv 


Author COI: No COI statement reported 
Methodological quality 
Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of pa- Unclear 
tients enrolled? 


Was a case-control design avoided? No 
Did the study avoid inappropriate exclusions? Unclear 
Did the study avoid inappropriate inclusions? Yes 


Could the selection of patients have intro- High risk 
duced bias? 


Are there concerns that the included pa- High 
tients and setting do not match the review 

question? 

DOMAIN 2: Index Test (Antigen tests) 

Were the index test results interpreted with- Yes 

out knowledge of the results of the reference 

standard? 


If a threshold was used, was it pre-specified? Yes 


Could the conduct or interpretation of the Low risk 
index test have introduced bias? 


Are there concerns that the index test, its Unclear 
conduct, or interpretation differ from the 

review question? 

DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly No 
classify the target condition? 


Were the reference standard results interpret- | Unclear 
ed without knowledge of the results of the in- 
dex tests? 
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Courtellemont 2020 (continued) 


Reference standard does not incorporate re- 
sult of index test? 


Could the reference standard, its conduct, 
or its interpretation have introduced bias? 


Are there concerns that the target condi- 
tion as defined by the reference standard 
does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between in- 
dex test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Did all participants receive a reference stan- 
dard? 


Were results presented per patient? 


Could the patient flow have introduced 
bias? 


Cradic 2020(a) 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Yes 


High risk 


High 


Yes 


Yes 


Unclear 


Yes 


Yes 


Unclear risk 


Single group study to estimate sensitivity and specificity: 

- symptomatic patients suspected of COVID-19 that met criteria for testing, either 
presenting to ED or as inpatients at single hospital (n=184) 

Recruitment: Not stated 


Prospective or retrospective: Prospective 


[Second cohort of paired samples from patients presenting to ED with signs/symp- 
toms of COVID-19 submitted for routine laboratory testing (n=182), extracted as 
Cradic 2020(b)] 


Setting: Mixed (ED/inpatients) 

Location: OhioHealth Riverside Methodist Hospital, Columbus 
Country: USA 

Dates: Not stated 

Symptoms and severity: All symptomatic, no further details. 
Demographics: Not stated 


Exposure history: Not stated 
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Cradic 2020(a) (continued) 


Index tests 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Test name: [A] ID NOW COVID-19 EUA [Study also evaluates [B] Diasorin Simplexa 
and [C] Roche cobas 6800 SARS-CoV-2; not eligible for this review] 


Manufacturer: Abbott Laboratories 

Target gene(s): RdRp 

Antigen target: n/a 

Test method: Isothermal PCR 

Samples used: NP swabs in UTM; collected on flocked swab, no other details, 
Transport media: 3 mL of sterile UVT (Becton Dickinson) 


Sample storage: asap, or stored for up to 72 hours at 2°C to 8°C. Following rou- 
tine testing, samples were stored frozen (s-80°C) until comparator testing with the 
Roche cobas assay could be completed 


Test operator: Not stated; infer laboratory staff. 
Definition of test positivity: as per manufacturer 
Blinding reported: Not stated 


Timing of samples: Unclear, infer upon presentation 


Reference standard: Composite reference standard, defined as the result obtained 
from at least 2 of the 3 assays conducted (Abbot ID NOW, Diasorin Simplexa or 
Roche cobas 6800 SARS-CoV-2) 


Definition of non-COVID cases: Same as index test; single negative for absence dis- 
ease 


Genetic target(s): RdRp, S or ORFlab gene (either present), ORFlab or E gene (both 
present for +ve, either present for presumptive +ve) 


Samples used: Same as index test 
Timing of reference standard: Not stated 
Blinded to index test: No (>=2 +ve) 


Incorporated index test: Yes 


Time interval between index and reference tests: Simultaneous - same swab 
All patients received same reference standard: Yes 

Missing data: None reported, no participant flow diagram reported 
Uninterpretable results: None reported 

Indeterminate results (index test): None reported 

Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 





Notes Funding: No funding statement reported 
Publication status: published 
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Cradic 2020(a) (continued) 





Source: American Journal of Clinical Pathology 


Author COI: No COI statement reported 
Methodological quality 
Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of pa- Unclear 
tients enrolled? 


Was a case-control design avoided? Yes 
Did the study avoid inappropriate exclusions? Unclear 
Did the study avoid inappropriate inclusions? Yes 


Could the selection of patients have intro- Unclear risk 
duced bias? 


Are there concerns that the included pa- Unclear 
tients and setting do not match the review 

question? 

DOMAIN 2: Index Test (Antigen tests) 

DOMAIN 2: Index Test (Rapid molecular tests) 

Were the index test results interpreted with- Unclear 

out knowledge of the results of the reference 

standard? 


If a threshold was used, was it pre-specified? Yes 


Could the conduct or interpretation of the Unclear risk 
index test have introduced bias? 


Are there concerns that the index test, its High 
conduct, or interpretation differ from the 
review question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly No 
classify the target condition? 


Were the reference standard results interpret- No 
ed without knowledge of the results of the in- 
dex tests? 


Reference standard does not incorporate re- No 
sult of index test? 


Could the reference standard, its conduct, High risk 
or its interpretation have introduced bias? 
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Cradic 2020(a) (continued) 





Are there concerns that the target condi- High 
tion as defined by the reference standard 
does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between in- Yes 
dex test and reference standard? 


Did all patients receive the same reference No 

standard? 

Were all patients included in the analysis? Unclear 

Did all participants receive a reference stan- Yes 

dard? 

Were results presented per patient? Yes 

Could the patient flow have introduced High risk 
bias? 


Cradic 2020(b) 


Study characteristics 


Patient Sampling Single group study to estimate sensitivity and specificity: paired samples from 
patients presenting to ED with signs/symptoms of COVID-19 submitted for rou- 
tine laboratory testing (n=182) 


Recruitment: Not stated 
Prospective or retrospective: Prospective 


[Second cohort of symptomatic patients suspected of COVID-19 that met crite- 
ria for testing, either presenting to ED or as inpatients at single hospital (n=184), 
extracted as Cradic 2020(a)] 


Patient characteristics and setting Setting: Emergency department 


Location: OhioHealth Laboratory Services, Columbus (presume ED at Ohio- 
Health Riverside Methodist Hospital) 


Country: USA 

Dates: Not stated 

Symptoms and severity: All symptomatic, no further details. 
Demographics: Not stated 


Exposure history: Not stated 


Index tests Test name: [A] ID NOW COVID-19 EUA [Study also evaluates [B] Diasorin Sim- 
plexa and [C] Roche cobas 6800 SARS-CoV-2; not eligible for this review] 


Manufacturer: Abbott Laboratories 


Target gene(s): RdRp 
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Cradic 2020(b) (continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Antigen target: n/a 
Test method: Isothermal PCR 


Samples used: NP swabs in UTM (collected as part of standard of care), plus di- 
rect testing of OP swabs and of nasal swabs (collected according to CDC instruc- 
tions) 


Transport media: presume as above for NP in UTM 
Sample storage: not stated 

Test operator: Not stated; infer laboratory staff. 
Definition of test positivity: as per manufacturer 
Blinding reported: Not stated 


Timing of samples: Unclear, infer upon presentation 


Reference standard: RT-PCR; Diasorin Simplexa 


Definition of non-COVID cases: Same as index test; single negative for absence 
disease 


Genetic target(s): S or ORFlab gene (either present) 
Samples used: NP swab in UTM 

Timing of reference standard: Not stated 

Blinded to index test: Not stated 


Incorporated index test: No 


Time interval between index and reference tests: Simultaneous; paired swabs 
All patients received same reference standard: Yes 

Missing data: None reported, no participant flow diagram reported 
Uninterpretable results: None reported 

Indeterminate results (index test): None reported 

Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 


Funding: No funding statement reported 
Publication status: published 
Source: American Journal of Clinical Pathology 


Author COI: No COI statement reported 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
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Was a consecutive or random sample of patients 
enrolled? 


Was a case-control design avoided? 
Did the study avoid inappropriate exclusions? 
Did the study avoid inappropriate inclusions? 


Could the selection of patients have introduced 
bias? 


Are there concerns that the included patients 
and setting do not match the review question? 


DOMAIN 2: Index Test (Antigen tests) 
DOMAIN 2: Index Test (Rapid molecular tests) 
Were the index test results interpreted without 
knowledge of the results of the reference stan- 
dard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the in- 
dex test have introduced bias? 


Are there concerns that the index test, its con- 
duct, or interpretation differ from the review 
question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly clas- 
sify the target condition? 


Were the reference standard results interpret- 
ed without knowledge of the results of the index 
tests? 


Reference standard does not incorporate result of 
index test? 


Could the reference standard, its conduct, or 
its interpretation have introduced bias? 


Are there concerns that the target condition 
as defined by the reference standard does not 
match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between index 
test and reference standard? 


Unclear 


Yes 
Unclear 
Yes 


Unclear risk 


Unclear 


Yes 


Unclear risk 


No 


Unclear 


Yes 


High risk 


Yes 


Cochrane Database of Systematic Reviews 





Low concern 


Unclear 


High 
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Did all patients receive the same reference stan- Yes 
dard? 
Were all patients included in the analysis? Unclear 


Did all participants receive areference standard? Yes 


Were results presented per patient? Yes 
Could the patient flow have introduced bias? Unclear risk 
Diao 2020 
Study characteristics 
Patient Sampling Single group estimating sensitivity and specificity for detecting active disease 


- samples from cases of suspected SARS-CoV-2 infection (n = 239) 
Recruitment: not stated if participants were consecutive 
Prospective or retrospective: retrospective 


Number of samples (samples with confirmed SARS-CoV-2): 239 (208) 


Patient characteristics and setting Setting: hospital (inpatients) 


Location: 7 centres, including General Hospital of Central Theatre Command, Wuhan 
No.7 People’s Hospital, Wuhan Pulmonary Hospital, Hubei Maternal and Child Hos- 
pital, Taikang Hospital, Hanyang Hospital and Wuguo Hospital. Urine study done in 
Southwest Hospital in Chongqing 


Country: China 

Dates: not stated 

Symptoms and severity: not stated 
Demographics: not stated 


Exposure history: not stated 


Index tests Test name: not stated 
Manufacturer: in house (but study authors affiliated to Bioeasy Technology) 
Antibody: monoclonal antibody 
Antigen target: nucleocapsid protein (N-antigen) 


Test method: FIA (fluorescence immunochromatographic); requires immunofluores- 
cence analyser 


Samples used: NP (all), urine (subgroup) 


Transport media: samples diluted and mixed in 500 pL saline solution; 100 uL trans- 
ferred to the sample well of the test card 


Sample storage: not reported 


Test operator: not stated; presume laboratory staff 
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Definition of test positivity: cut-off value was determined by testing 100 nasal swab 
samples of healthy people and calculated as the mean value of the fluorescence signal 
plus 5 SD. 


Blinding reported: done in parallel; blinded 


Timing of samples: not stated 


Target condition and reference standard(s) | Reference standard: RT-PCR (Daan Gene kit); performed on ABI Prism 7500 and Light 
Cycler 480 real-time PCR system. Threshold < 40 Ct; threshold < 30 Ct also investigated 
Definition of non-COVID cases: all participants underwent 3 nucleic acid tests, and the 
results of each nucleic acid test were verified by 2 COVID-19 nucleic acid test kits. 


Genetic target(s): ORFlab and N gene 
Samples used: NP swab, same as for index test 
Timing of reference standard: not stated 
Blinded to index test: done in parallel; blinded 


Incorporated index test: no 


Flow and timing Time interval between index and reference tests: done in parallel 
All participants received same reference standard: yes 
Missing data: not reported, no participant flow diagram reported 
Uninterpretable results: not reported 
Indeterminate results (index test): none reported 
Indeterminate results (reference standard): none described 


Unit of analysis: participants 
Comparative 


Notes Funding: this research was supported by grants from National Key R&D Program of Chi- 
na (2016YFA0502204); Chongqing Health Commission COVID-19 Project (2020ZX01). 


Publication status: preprint (not peer-reviewed) 
Source: medRxiv preprint 


Author COI: study authors declare no CO! present; 1 affiliated to Shenzhen Bioeasy 
Biotechnology Co. Ltd. 


Methodological quality 
Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of Unclear 
patients enrolled? 





Was a case-control design avoided? Yes 
Did the study avoid inappropriate exclu- Unclear 
sions? 
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Diao 2020 (continued) 


Did the study avoid inappropriate inclu- 
sions? 


Could the selection of patients have in- 
troduced bias? 


Are there concerns that the included pa- 
tients and setting do not match the re- 
view question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test results interpreted 
without knowledge of the results of the ref- 
erence standard? 


If a threshold was used, was it pre-speci- 
fied? 


Could the conduct or interpretation of 
the index test have introduced bias? 


Are there concerns that the index test, 
its conduct, or interpretation differ from 
the review question? 


Unclear 


Unclear risk 


Unclear 


Yes 


Unclear risk 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correct- 
ly classify the target condition? 


Were the reference standard results inter- 
preted without knowledge of the results of 
the index tests? 


Reference standard does not incorporate 
result of index test? 


Could the reference standard, its con- 
duct, or its interpretation have intro- 
duced bias? 

Are there concerns that the target con- 
dition as defined by the reference stan- 
dard does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between 
index test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Yes 


Yes 


Yes 


Low risk 


Yes 


Yes 


Unclear 


Unclear 


High 


High 
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Did all participants receive a reference Yes 
standard? 


Were results presented per patient? Yes 


Could the patient flow have introduced Unclear risk 
bias? 


Dust 2020 


Study characteristics 


Patient Sampling Design unclear; coded as two group study: 
[1] SARS-CoV-2 positive samples submitted for routine viral diagnostic testing 
(n=20 evaluated with Xpert Xpress) 
[2] samples positive for other respiratory infection from those submitted for 
routine viral diagnostic testing (n=18) 
(Sampled from total n of 177; 65 SARS-CoV-2 positive, 112 SARS-CoV-2 negative, 
including 57 positive for other respiratory viruses) 
[Study also reports results for reference panel of simulated specimens; not ex- 
tracted for this review) 


Recruitment: Convenience 


Prospective or retrospective: Retrospective 


Patient characteristics and setting Setting: Unclear; submitted to laboratory 
Location: Cadham Provincial Laboratory (CPL), Manitoba 
Country: Canada 
Dates: Not stated 
Symptoms and severity: Not reported 
Demographics: Not reported 


Exposure history: Not reported 


Index tests Test name: Xpert Xpress (no product code) 
[also evaluates cobas SARS-CoV-2 RT-PCR (Roche) and three in-house RT-PCR 
assays; not eligible for this review] 


Manufacturer: Cepheid Inc 

Antibody: E, N2 

Antigen target: n/a 

Test method: automated RT-PCR 

Samples used: NP swabs in VTM; collection not reported 
Transport media: VTM; no further detail 

Sample storage: Not stated, could be archived samples 


Test operator: Not stated 
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Dust 2020 (continued) 





Definition of test positivity: Not stated; presume as per manufacturer (presump- 
tive positives not mentioned) 


Blinding reported: Not stated 


Timing of samples: Not stated 


Target condition and reference standard(s) Reference standard: In-house RT-PCR (extraction with MagMAX™ reagents on a 
KingFisher™ instrument (Thermo Scientific™) and RT-PCR performed on a Bio- 
Rad CFX96 real time PCR detection system); Ct threshold NR 


Definition of non-COVID cases: As for cases; single negative 
Genetic target(s): E, N1 

Samples used: NP (as for index) 

Timing of reference standard: Not stated 

Blinded to index test: Not stated 


Incorporated index test: No 


Flow and timing Time interval between index and reference tests: Simultaneous (same swab) 
All patients received same reference standard: Yes 
Missing data: None reported, no participant flow diagram reported 
Uninterpretable results: None reported 
Indeterminate results (index test): None reported 
Indeterminate results (reference standard): None reported 


Unit of analysis: Not stated 
Comparative 
Notes 
Methodological quality 
Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of patients No 
enrolled? 


Was a case-control design avoided? No 
Did the study avoid inappropriate exclusions? No 
Did the study avoid inappropriate inclusions? Unclear 


Could the selection of patients have introduced High risk 
bias? 


Are there concerns that the included patients High 
and setting do not match the review question? 
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Dust 2020 (continued) 
DOMAIN 2: Index Test (Antigen tests) 


DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test results interpreted without 
knowledge of the results of the reference stan- 
dard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the in- 
dex test have introduced bias? 


Are there concerns that the index test, its con- 
duct, or interpretation differ from the review 
question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly clas- 
sify the target condition? 


Were the reference standard results interpret- 
ed without knowledge of the results of the index 
tests? 


Reference standard does not incorporate result of 
index test? 


Could the reference standard, its conduct, or 
its interpretation have introduced bias? 


Are there concerns that the target condition 
as defined by the reference standard does not 
match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between index 
test and reference standard? 


Did all patients receive the same reference stan- 
dard? 


Were all patients included in the analysis? 
Did all participants receive a reference standard? 
Were results presented per patient? 


Could the patient flow have introduced bias? 


Fenollar 2020(a) 


Study characteristics 


Unclear 


Unclear 


Unclear risk 


No 


Unclear 


Yes 


High risk 


Yes 


Yes 


Unclear 
Yes 
Unclear 


Unclear risk 


Unclear 


High 
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Fenollar 2020(a) (continued) 


Patient Sampling 


Two cohorts of patients presenting for COVID-19 testing at the same institution. 
This extraction relates to: 

[1] Single group study to estimate sensitivity alone: symptomatic patients, all 
PCR positive (n=182) 

Fenollar 2020(b) reports data for [2] Single group study to estimate both sensitivi- 
ty and specificity: asymptomatic contacts of confirmed cases (n=159) 


Recruitment: Prospective 


Prospective or retrospective: Unclear 


Patient characteristics and setting 


Index tests 


Target condition and reference standard(s) 


Setting: Unclear; COVID-19 testing 

Location: Institut Hospitalo-universitaire Méditerranée Infection, Marseille, 
Country: France 

Dates: Sep 21 to Oct 2 2020 

Symptoms and severity: Not stated; all symptomatic 

Ct values for 154 pts: Ct <=20: 58, 38%; Ct 21-25: 49, 32%; Ct 26-30: 39, 25%; Ct 
31-34: 8, 5% 

Demographics: Not reported 


Exposure history: [1] Not stated 


Test name: Panbio COVID-19 Ag 

Manufacturer: Abbott 

Antibody: NP 

Antigen target: Not stated 

Test method: Not stated 

Samples used: NP 

Transport media: Not stated; appears to be direct testing 
Sample storage: Tested within 1 hour 

Test operator: Not stated 

Definition of test positivity: Visual line; as per manufacturer 


Blinding reported: Not stated, but presume yes as conducted within 1h of collec- 
tion 


Timing of samples: Not stated 


Reference standard: Automated RT-PCR; VitaPCR (Credo diagnostics, Singapore) 


Definition of non-COVID cases: n/a 

Genetic target(s): Not stated 

Samples used: NP (paired, from opposite nostril) 
Timing of reference standard: Not stated 
Blinded to index test: Unclear 


Incorporated index test: No 
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Fenollar 2020(a) (continued) 


Flow and timing 


Comparative 


Notes 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of patients 
enrolled? 


Was a case-control design avoided? 
Did the study avoid inappropriate exclusions? 
Did the study avoid inappropriate inclusions? 


Could the selection of patients have intro- 
duced bias? 


Are there concerns that the included patients 
and setting do not match the review ques- 
tion? 

DOMAIN 2: Index Test (Antigen tests) 

Were the index test results interpreted without 
knowledge of the results of the reference stan- 
dard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the in- 
dex test have introduced bias? 


Time interval between index and reference tests: Simultaneous; paired swabs 
All patients received same reference standard: Yes 

Missing data: None reported 

Uninterpretable results: None reported, no participant flow diagram reported 
Indeterminate results (index test): None reported 

Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 


Funding: Supported by the Méditerranée-Infection Foundation and the French 
Agence Nationale de la Recherche under reference Investissements d’Avenir 
Méditerranée Infection 10-IAHU-03 and Région Provence-Alpes-Céte d’Azur and 
European funding FEDER IHUBIOTK. 


Source: Accepted manuscript 


Author COI: Pr Raoult and Pr Drancourt are co-founders of the Pocrame startup 
that develops diagnostic devices for infectious diseases 


Authors' judgement Risk of bias Applicability concerns 


Unclear 


No 
Unclear 
Unclear 


High risk 


High 


Yes 


Yes 


Low risk 
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Fenollar 2020(a) (continued) 





Are there concerns that the index test, its con- Unclear 
duct, or interpretation differ from the review 

question? 

DOMAIN 2: Index Test (Rapid molecular tests) 

DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly No 
classify the target condition? 


Were the reference standard results interpret- Unclear 
ed without knowledge of the results of the index 


tests? 


Reference standard does not incorporate result Yes 
of index test? 


Could the reference standard, its conduct, or High risk 
its interpretation have introduced bias? 


Are there concerns that the target condition High 
as defined by the reference standard does not 
match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between index Yes 
test and reference standard? 


Did all patients receive the same reference stan- Yes 





dard? 
Were all patients included in the analysis? Unclear 
Did all participants receive a reference stan- Yes 
dard? 
Were results presented per patient? Yes 
Could the patient flow have introduced bias? Unclear risk 
Fenollar 2020(b) 
Study characteristics 
Patient Sampling Two cohorts of patients presenting for COVID-19 testing at the same institution. 
This extraction relates to: 
[2] Single group study to estimate both sensitivity and specificity: asymptomatic 
contacts of confirmed cases (n=159) 
See Fenollar 2020(a) for extraction of additional cohort: 
[1] Single group study to estimate sensitivity alone: symptomatic patients, all 
PCR positive (n=182) 
Recruitment: Prospective 
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Fenollar 2020(b) (continued) 


Patient characteristics and setting 


Index tests 


Target condition and reference standard(s) 


Flow and timing 


Prospective or retrospective: Unclear 


Setting: Unclear 

Location: Institut Hospitalo-universitaire Méditerranée Infection, Marseille, 
Country: France 

Dates: Sep 21 to Oct 2 2020 

Symptoms and severity: All asymptomatic; 21/22 cases had Ct >25 
Demographics: Not reported 


Exposure history: [2] All described as contacts 


Test name: PANBIO COVID-19 Ag 

Manufacturer: Abbott 

Antibody: NP 

Antigen target: Not stated 

Test method: Not stated 

Samples used: NP 

Transport media: Not stated; appears to be direct testing 
Sample storage: Tested within 1 hour 

Test operator: Not stated 

Definition of test positivity: Visual line; as per manufacturer 
Blinding reported: Not stated, conducted first 


Timing of samples: Not stated 


Reference standard: Automated RT-PCR; VitaPCR (Credo diagnostics, Singapore) 
Definition of non-COVID cases: As for cases; single negative 

Genetic target(s): Not stated 

Samples used: NP (paired, from opposite nostril) 

Timing of reference standard: Not stated 

Blinded to index test: Unclear 


Incorporated index test: No 


Time interval between index and reference tests: Simultaneous; paired swabs 
All patients received same reference standard: Yes 

Missing data: None reported, no participant flow diagram reported 
Uninterpretable results: None reported 

Indeterminate results (index test): None reported 


Indeterminate results (reference standard): None reported 
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Fenollar 2020(b) (continued) 





Unit of analysis: Patients 

Comparative 

Notes Funding: Supported by the Méditerranée-Infection Foundation and the French 
Agence Nationale de la Recherche under reference Investissements d’Avenir 


Méditerranée Infection 10-IAHU-03 and Région Provence-Alpes-Céte d’Azur and 
European funding FEDER IHUBIOTK. 


Source: Accepted manuscript 


Author COI: Pr Raoult and Pr Drancourt are co-founders of the Pocrame startup 
that develops diagnostic devices for infectious diseases 


Methodological quality 
Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of patients Unclear 
enrolled? 


Was a case-control design avoided? Yes 
Did the study avoid inappropriate exclusions? Unclear 
Did the study avoid inappropriate inclusions? Unclear 


Could the selection of patients have introduced Unclear risk 
bias? 


Are there concerns that the included patients Unclear 
and setting do not match the review question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test results interpreted without Yes 

knowledge of the results of the reference stan- 

dard? 

If a threshold was used, was it pre-specified? Yes 

Could the conduct or interpretation of the in- Low risk 


dex test have introduced bias? 

Are there concerns that the index test, its con- Unclear 
duct, or interpretation differ from the review 

question? 

DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly clas- No 
sify the target condition? 
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Fenollar 2020(b) (continued) 


Were the reference standard results interpret- 
ed without knowledge of the results of the index 
tests? 


Reference standard does not incorporate result of 


index test? 


Could the reference standard, its conduct, or 
its interpretation have introduced bias? 


Are there concerns that the target condition 
as defined by the reference standard does not 
match the question? 


Unclear 


Yes 


High risk 


High 


DOMAIN 4: Flow and Timing 


Yes 


Was there an appropriate interval between index 


test and reference standard? 


Did all patients receive the same reference stan- 
dard? 


Were all patients included in the analysis? 


Yes 


Unclear 


Yes 


Did all participants receive a reference standard? 


Yes 


Were results presented per patient? 


Unclear risk 


Could the patient flow have introduced bias? 


FIND 2020a 


Study characteristics 


Patient Sampling 


Single group study to estimate sensitivity and specificity: 


Patient characteristics and setting 


Index tests 


- patients with symptoms consistent with COVID-19 (meeting national definition 
for testing) presenting at a community testing clinic 


Recruitment: Consecutive recruitment 


Prospective or retrospective: Prospective 


Setting: Community (COVID-19 testing clinic) 

Location: Institution not described; Marica, Rio de Janeiro 
Country: Brazil 

Dates: 30 Jul to 21 Aug 2020 

Symptoms and severity: All symptomatic; no further details 


Demographics: mean age 40y (range 4 to 84); reported for 396 participants 
181 (45%) male 


Exposure history: Not stated 


Test name: NowCheck COVID-19 Ag test (RG1901DG) 
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FIND 2020a (Continued) 


Target condition and reference standard(s) 


Manufacturer: Bionote Inc 

Antibody: SARS-CoV-2 nucleocapsid antigen 

Antigen target: Mouse monoclonal SARS-CoV-2 antibodies 

Test method: Rapid chromatographic immunoassay in lateral flow format 
Samples used: Proprietary NP swab collected by HCW 


Transport media: No transport media. Sample is immediately transferred to 
proprietary tube containing extraction buffer. 


Sample storage: Test should be performed as soon as possible after collection. 
Specimens may be stored at RT for 1h or 2-8°C for 4h. 


Test operator: HCW 

Definition of test positivity: Presence of visible control and test lines 
Blinding reported: Yes 

Timing of samples: median 4 days p.s.o (IQR 3, 6 days); 

day <0 to 3 152, 39% 


day 4 to 7 180, 46% 
day >=8 58, 15% 


Reference standard: RT-PCR (in-house assay based on the US CDC protocol); Ct 


Flow and timing 


Comparative 


threshold of 37 


Definition of non-COVID cases: Same as for cases. Single negative PCR required 
for absence of infection 


Genetic target(s): N1, N2 
Samples used: NP swabs 
Timing of reference standard: Same timing as per NP swabs for index test 
Blinded to index test: Yes 


Incorporated index test: No 


Time interval between index and reference tests: 0 to several days based on PCR 
turnaround times at the lab 


All patients received same reference standard: Yes 

Missing data: Reports 0 invalid results 

Uninterpretable results: None reported 

Indeterminate results (index test): None reported 
Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 





Notes Funding: FIND 
Publication status: published 
Source: FIND website/IFU index test 
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FIND 2020a (continued) 





Author COI: None stated (these are independent evaluations) 
Methodological quality 
Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of patients Yes 
enrolled? 


Was a case-control design avoided? Yes 
Did the study avoid inappropriate exclusions? Yes 
Did the study avoid inappropriate inclusions? Yes 


Could the selection of patients have introduced Low risk 
bias? 


Are there concerns that the included patients Low concern 
and setting do not match the review question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test results interpreted without Yes 

knowledge of the results of the reference stan- 

dard? 

If a threshold was used, was it pre-specified? Yes 

Could the conduct or interpretation of the in- Low risk 


dex test have introduced bias? 

Are there concerns that the index test, its con- Low concern 
duct, or interpretation differ from the review 

question? 

DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly clas- No 
sify the target condition? 


Were the reference standard results interpret- Yes 
ed without knowledge of the results of the index 
tests? 


Reference standard does not incorporate result of | Yes 
index test? 


Could the reference standard, its conduct, or High risk 
its interpretation have introduced bias? 
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FIND 2020a (continued) 


Are there concerns that the target condition 
as defined by the reference standard does not 
match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between index 
test and reference standard? 


Did all patients receive the same reference stan- 
dard? 


High 


Yes 


Yes 


Yes 


Were all patients included in the analysis? 


Yes 


Did all participants receive a reference standard? 


Were results presented per patient? 


Could the patient flow have introduced bias? 


FIND 2020b 


Yes 


Low risk 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Single group study to estimate sensitivity and specificity at single site: 

- patients seeking COVID-19 testing at main testing centre; described as pre- 
senting either with symptoms compatible with a SARS-CoV-2 infection, or with 
a known positive contact or asymptomatic HCWs (n=535) 


Recruitment: Consecutive recruitment 


Prospective or retrospective: Prospective 


Setting: Community (main testing centre) 


Index tests 


Location: Hopitaux Universitaires de Geneve (HUG), Geneva 
Country: Switzerland 

Dates: 9-16 Oct 2020 

Symptoms and severity: 534/535 symptomatic (99%) 


Demographics: Mean age 38.5y (16 to 85y) 
247, 46% male 


Exposure history: Not stated 


Test name: PanbioTM Covid-19 Ag Rapid Test (41FK10) 
Manufacturer: Abbott 

Antibody: Not reported 

Antigen target: Not reported 

Test method: CGIA (from product insert) 


Samples used: NP 
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FIND 2020b (continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Transport media: No transport media; assay buffer used 


Sample storage: Author contact advises tested as soon as possible and within 
the time limit specified in the IFU 


Test operator: HCW 
Definition of test positivity: Presence of visible control and test lines 
Blinding reported: Yes 


Timing of samples: time pso recorded for 115/124, 92%. Day 0-3 89, 78%; Day 
4-7 23, 20%; Day 8+ 3, 3% 


Reference standard: RT-PCR Roche Cobas; Ct threshold <40 (from Figure) 


Definition of non-COVID cases: Same as for cases. Single negative PCR required 
for absence of infection 


Genetic target(s): Not stated 
Samples used: NP swab (paired, from contralateral nostril) 


Timing of reference standard: Not stated; author contact advises only paired 
swabs used. 


Blinded to index test: Yes 


Incorporated index test: No 


Time interval between index and reference tests: Paired swabs; 0 to several 
days based on PCR turnaround times at the lab 


All patients received same reference standard: Yes 

Missing data: Reports 0 invalid. 

Uninterpretable results: None reported 

Indeterminate results (index test): None reported 
Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 


Funding: FIND 
Publication status: published 
Source: FIND/HUG website/IFU index test 


Author COI: None stated (these are independent evaluations) 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
Was a consecutive or random sample of patients Yes 
enrolled? 
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FIND 2020b (continued) 


Was a case-control design avoided? 
Did the study avoid inappropriate exclusions? 
Did the study avoid inappropriate inclusions? 


Could the selection of patients have introduced 
bias? 


Are there concerns that the included patients 
and setting do not match the review question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test results interpreted without 
knowledge of the results of the reference standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the index 
test have introduced bias? 


Are there concerns that the index test, its con- 
duct, or interpretation differ from the review 
question? 

DOMAIN 2: Index Test (Rapid molecular tests) 
DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly classi- 
fy the target condition? 


Were the reference standard results interpreted 
without knowledge of the results of the index tests? 


Reference standard does not incorporate result of 
index test? 


Could the reference standard, its conduct, or its 
interpretation have introduced bias? 


Are there concerns that the target condition 
as defined by the reference standard does not 
match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between index 
test and reference standard? 


Did all patients receive the same reference stan- 
dard? 


Were all patients included in the analysis? 


Did all participants receive a reference standard? 


Yes 
Yes 
Yes 


Low risk 


Yes 


Yes 


Low risk 


No 


Yes 


Yes 


High risk 


Yes 


Yes 


Yes 


Yes 


Low concern 


Low concern 


High 
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FIND 2020b (continued) 


Were results presented per patient? 


Could the patient flow have introduced bias? 


FIND 2020c (BR) 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Index tests 


Target condition and reference standard(s) 


Yes 


Low risk 


Single group study to estimate sensitivity and specificity at three sites; this extrac- 
tion is for data from Brazil (see FIND 2020c (CH) and Kruger 2020(c) for extraction 
of data from other sites): 

- ambulatory patients meeting national suspect definition for COVID-19 testing 
presenting at a community testing clinic in Brazil 


Recruitment: Consecutive recruitment 


Prospective or retrospective: Prospective 


Setting: Community testing clinic 

Location: Macae, state of Rio de Janeiro 

Country: Brazil 

Dates: 13-30 Jul 2020 

Symptoms and severity: 392/397 (99%) symptomatic; no further details 
Demographics: mean age 37y (2-94) (397 participants); 229/398 male (57%) 


Exposure history: Not stated 


Test name: STANDARD Q COVID-19 Ag (09COV30D) 

Manufacturer: SD Biosensor Inc 

Antibody: Not reported 

Antigen target: Not reported 

Test method: Rapid chromatographic immunoassay in lateral flow format 
Samples used: NP; collected by HCW 

Transport media: Proprietary swab/media provided by SD Biosensor 


Sample storage: Author contact advises tested as soon as possible and within the 
time limit specified in the IFU 


Test operator: HCW 
Definition of test positivity: Presence of visible control and test lines 
Blinding reported: Yes 


Timing of samples: median 5 days p.s.o (IQR 4, 6 days) (for 397 patients); day <0 to 
3 85, 21%; day 4 to 7 273, 69%; day >=8 39, 10% 


Reference standard: RT-PCR (In-house; Lab-developed assay based on the US CDC 
protocol; Ct threshold not stated; author contact advises Ct thresholds as per as- 
say IFUs 
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FIND 2020c (BR) (Continued) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Definition of non-COVID cases: Same as for cases. Single negative PCR required for 
absence of infection 


Genetic target(s): N1 and N2 
Samples used: NP swabs 


Timing of reference standard: Not stated; author contact advises only paired 
swabs used. 


Blinded to index test: Yes 


Incorporated index test: No 


Time interval between index and reference tests: Paired swabs; 0 to several days 
based on PCR turnaround times at the lab 


All patients received same reference standard: Yes 

Missing data: Reports 0 missing data 

Uninterpretable results: None reported 

Indeterminate results (index test): None reported 
Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 


Funding: FIND 
Publication status: published 
Source: FIND website/IFU index test 


Author COI: None stated (these are independent evaluations) 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
Was a consecutive or random sample of pa- Yes 
tients enrolled? 
Was a case-control design avoided? Yes 
Did the study avoid inappropriate exclusions? Yes 
Did the study avoid inappropriate inclusions? Yes 
Could the selection of patients have intro- Low risk 
duced bias? 
Are there concerns that the included pa- Low concern 
tients and setting do not match the review 
question? 
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FIND 2020c (BR) (Continued) 





DOMAIN 2: Index Test (Antigen tests) 

Were the index test results interpreted without Yes 
knowledge of the results of the reference stan- 

dard? 


If a threshold was used, was it pre-specified? Yes 


Could the conduct or interpretation of the Low risk 
index test have introduced bias? 


Are there concerns that the index test, its Low concern 
conduct, or interpretation differ from the re- 

view question? 

DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly No 
classify the target condition? 


Were the reference standard results interpret- Yes 
ed without knowledge of the results of the in- 
dex tests? 


Reference standard does not incorporate result Yes 
of index test? 


Could the reference standard, its conduct, or High risk 
its interpretation have introduced bias? 


Are there concerns that the target condition High 
as defined by the reference standard does 
not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between in- Yes 
dex test and reference standard? 





Did all patients receive the same reference Yes 
standard? 
Were all patients included in the analysis? Yes 
Did all participants receive a reference stan- Yes 
dard? 
Were results presented per patient? Yes 
Could the patient flow have introduced bias? Low risk 
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FIND 2020c (CH) 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Index tests 


Target condition and reference standard(s) 


Single group study to estimate sensitivity and specificity at single site; this extrac- 
tion is for data from Switzerland (see FIND 2020c (BR) and Kruger 2020(c) for ex- 
traction of data from other sites): 

- patients seeking COVID-19 testing at main testing centre; described as present- 
ing either with symptoms compatible with a SARS-CoV2 infection, or with a known 
positive contact or asymptomatic HCWs (n=529; from total cohort of 1064 volun- 
teers) 


Recruitment: Consecutive recruitment 


Prospective or retrospective: Prospective 


Setting: Community (main testing centre) 

Location: Hopitaux Universitaires de Geneve (HUG), Geneva 
Country: Switzerland 

Dates: 9-23 Oct 2020 


Symptoms and severity: Not stated; time pso recorded for 183/191, 96% 141/183 
COVID positive cases had symptoms for 0-4days (77%) 


Demographics: Not stated 


Exposure history: Not stated 


Test name: STANDARD Q COVID-19 Ag (09COV30D) 

Manufacturer: SD Biosensor Inc 

Antibody: Not reported 

Antigen target: Not reported 

Test method: Rapid chromatographic immunoassay in lateral flow format 
Samples used: NP 

Transport media: Proprietary swab/media provided by SD Biosensor 


Sample storage: Author contact advises tested as soon as possible and within the 
time limit specified in the IFU 


Test operator: HCW 
Definition of test positivity: Presence of visible control and test lines 
Blinding reported: Yes 


Timing of samples: median not reported (range 0 to 15); day <0 to 3 - 122, 67%; day 
4-7 - 54, 29%; Day 8+ - 7, 34% 


Reference standard: RT-PCR Roche Cobas; Ct threshold <40 (from Figure) 


Definition of non-COVID cases: Same as for cases. Single negative PCR required for 
absence of infection 


Genetic target(s): Not stated 


Samples used: NP swab (paired, from contralateral nostril) 
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FIND 2020c (CH) (continued) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Timing of reference standard: Not stated; author contact advises only paired 
swabs used. 


Blinded to index test: Yes 


Incorporated index test: No 


Time interval between index and reference tests: Paired swabs; 0 to several days 
based on PCR turnaround times at the lab 


All patients received same reference standard: Yes 

Missing data: Reports 0 missing data 

Uninterpretable results: None reported 

Indeterminate results (index test): None reported 
Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 


Funding: FIND 
Publication status: published 
Source: FIND & HUG websites/IFU index test 


Author COI: None stated (these are independent evaluations) 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
Was a consecutive or random sample of pa- Yes 
tients enrolled? 
Was a case-control design avoided? Yes 
Did the study avoid inappropriate exclusions? Yes 
Did the study avoid inappropriate inclusions? Yes 
Could the selection of patients have intro- Low risk 
duced bias? 
Are there concerns that the included pa- Low concern 
tients and setting do not match the review 
question? 
DOMAIN 2: Index Test (Antigen tests) 
Were the index test results interpreted without Yes 
knowledge of the results of the reference stan- 
dard? 
If a threshold was used, was it pre-specified? Yes 
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FIND 2020c (CH) (Continued) 





Could the conduct or interpretation of the Low risk 
index test have introduced bias? 


Are there concerns that the index test, its Low concern 
conduct, or interpretation differ from the re- 

view question? 

DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly No 
classify the target condition? 


Were the reference standard results interpret- Yes 
ed without knowledge of the results of the in- 
dex tests? 


Reference standard does not incorporate result Yes 
of index test? 


Could the reference standard, its conduct, or High risk 
its interpretation have introduced bias? 


Are there concerns that the target condition High 
as defined by the reference standard does 
not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between in- Yes 
dex test and reference standard? 


Did all patients receive the same reference Yes 

standard? 

Were all patients included in the analysis? Yes 

Did all participants receive a reference stan- Yes 

dard? 

Were results presented per patient? Yes 

Could the patient flow have introduced bias? Low risk 


FIND 2020d (BR) 


Study characteristics 


Patient Sampling Single group study to estimate sensitivity and specificity at two sites; this extraction 
is for data from Brazil (see FIND 2020d (DE) for extraction of data from other site): 
- adults in community meeting national suspect definition for COVID-19 testing pre- 
senting at [1] a community testing clinic or 
[2] a tertiary level hospital 


Recruitment: Consecutive recruitment 
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FIND 2020d (BR) (Continued) 


Patient characteristics and setting 


Index tests 


Target condition and reference standard(s) 


Flow and timing 


Prospective or retrospective: Prospective 


Setting: Mixed; community testing clinic and tertiary hospital 


Location: [1] Macae, state of Rio de Janeiro, [2] Universidade Federal do Rio de 
Janeiro (UFRJ) 


Country: Brazil 

Dates: [1] 17 Aug to 9 Sept, [2] 11 Jul to 8 Aug 

Symptoms and severity: 421/450 (94%) symptomatic; no further details 
Demographics: mean age 39 y (0-95y) (451 participants); 185 male (41%) 


Exposure history: Not stated 


Test name: STANDARD F COVID-19 Ag FIA (F-NCOV-01G, 10COV30D) 
Manufacturer: SD Biosensor Inc 

Antibody: Not reported 

Antigen target: Not reported 

Test method: FIA 

Samples used: NP; collected by HCW 

Transport media: Proprietary swab/media provided by SD Biosensor 


Sample storage: Author contact advises tested as soon as possible and within the 
time limit specified in the IFU 


Test operator: HCW 


Definition of test positivity: As per STANDARD F Analyzer; cut-off index (COI) 2 1.0 (as 
per IFU) 


Blinding reported: Yes 


Timing of samples: median 4 days p.s.o (IQR 3, 6 days) (for 421 patients). Day <0 to 3 
- 131, 31%; day 4 to 7 - 248, 59%; day >=8 - 42, 10% 


Reference standard: RT-PCR; one of two in-house assays: 

1. Lab-developed assay based on the US CDC protocol; 

2. Lab-developed assay based on the Charité Universitatsmedizin Berlin protocol. 
Ct thresholds not stated; author contact advises Ct thresholds as per assay IFUs 


Definition of non-COVID cases: Same as for cases. Single negative PCR required for 
absence of infection 


Genetic target(s): 1. N1 and N2; 2. Eand RdRp 
Samples used: NP swabs 


Timing of reference standard: Not stated; author contact advises only paired swabs 
used. 


Blinded to index test: Yes 


Incorporated index test: No 


Time interval between index and reference tests: Paired swabs; 0 to several days 
based on PCR turnaround times at the lab 
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FIND 2020d (BR) (Continued) 


All patients received same reference standard: Yes 


Missing data: Reports 0 missing data 


Uninterpretable results: None reported 


Indeterminate results (index test): None reported 


Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 
Comparative 


Notes Funding: FIND 
Publication status: published 


Source: FIND website/IFU for index test 


Author COI: None stated (these are independent evaluations) 


Methodological quality 
Item Authors' judgement Risk of bias 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of pa- Yes 
tients enrolled? 


Was a case-control design avoided? Yes 
Did the study avoid inappropriate exclusions? Yes 
Did the study avoid inappropriate inclusions? Yes 


Could the selection of patients have intro- Low risk 
duced bias? 


Are there concerns that the included pa- 

tients and setting do not match the review 
question? 

DOMAIN 2: Index Test (Antigen tests) 

Were the index test results interpreted with- Yes 
out knowledge of the results of the reference 
standard? 


If a threshold was used, was it pre-specified? Yes 


Could the conduct or interpretation of the Low risk 
index test have introduced bias? 


Are there concerns that the index test, its 
conduct, or interpretation differ from the 


review question? 


DOMAIN 2: Index Test (Rapid molecular tests) 


Applicability concerns 


Low concern 


Low concern 
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FIND 2020d (BR) (continued) 
DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly 
classify the target condition? 


Were the reference standard results interpret- 
ed without knowledge of the results of the in- 
dex tests? 


Reference standard does not incorporate re- 
sult of index test? 


Could the reference standard, its conduct, 
or its interpretation have introduced bias? 


Are there concerns that the target condi- 
tion as defined by the reference standard 
does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between in- 
dex test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Did all participants receive a reference stan- 
dard? 


Were results presented per patient? 


Could the patient flow have introduced 
bias? 


FIND 2020d (DE) 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


No 


Yes 


Yes 


High risk 


High 


Yes 


Yes 


Yes 


Yes 


Yes 


Low risk 


Single group study to estimate sensitivity and specificity at two sites; this extraction is 
for data from Germany (see FIND 2020d (BR) for extraction of data from other site): 

- adults in community meeting national suspect definition for COVID-19 testing pre- 
senting at 

[1] a drive-in testing centre or 

[2] ambulatory testing clinic 


Recruitment: Consecutive recruitment 


Prospective or retrospective: Prospective 


Setting: Community 


Location: [1] Heidelberg drive in testing, [2] Berlin: Ambulatory testing clinic of Charité 
- University Hospital 
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FIND 2020d (DE) (Continued) 


Index tests 


Target condition and reference standard(s) 


Flow and timing 


Country: Germany 

Dates: [1] Heidelberg: 15 June-18July 2020, [2] Berlin: 6 July - 23 Sept 2020 
Symptoms and severity: 517/669 (77%) symptomatic; no further details 
Demographics: mean age 38 y (18-85y) (676 participants); 307 male (46%) 


Exposure history: Not stated 


Test name: STANDARD F COVID-19 Ag FIA (F-NCOV-01G, 10COV30D) 
Manufacturer: SD Biosensor Inc 

Antibody: Not reported 

Antigen target: Not reported 

Test method: FIA 

Samples used: [1] NP; [2] Combined NOP swabs; collected by HCW 
Transport media: Proprietary swab/media provided by SD Biosensor 


Sample storage: Author contact advises tested as soon as possible and within the time 
limit specified in the IFU 


Test operator: HCW 


Definition of test positivity: As per STANDARD F Analyzer; cut-off index (COl) 2 1.0 (as 
per IFU) 


Blinding reported: Yes 
Timing of samples: median 3 days p.s.o (IQR 2,5 days) (for 505 patients). Day <0 to 3 - 
257, 51%; day 4 to 7 - 202, 47%; day >=8 - 46, 9% 


Reference standard: RT-PCR; one of 5 assays: 

1. Cobas SARS-CoV-2 (Roche Diagnostics Inc); N = 342 

2. Abbott RealTime SARS-CoV-2 (Abbott Molecular, Inc) N=1 

3. Allplex 2019-nCov Assay (Seegene Inc); N = 20 

4. LightMix® Modular SARS-CoV (COVID19) E-gene (Tib Molbiol); N = 233 

5. Cobas (Roche) or Thermofisher (Multiplex TaqPath COVID-19 CE-IVD RT-PCR Kit); N = 
80 

Ct thresholds not stated; author contact advises Ct thresholds as per assay IFUs 


Definition of non-COVID cases: Same as for cases. Single negative PCR required for ab- 
sence of infection 


Genetic target(s): Not stated apart from 3. E gene 
Samples used: NP (n=305), NOP (n=342) and/or OP swabs (n=32) 


Timing of reference standard: Not stated; author contact advises only paired swabs 
used. 


Blinded to index test: Yes 


Incorporated index test: No 


Time interval between index and reference tests: Paired swabs; 0 to several days based 
on PCR turnaround times at the lab 


All patients received same reference standard: Yes 
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FIND 2020d (DE) (Continued) 


Missing data: Reports 0 missing data 


Uninterpretable results: None reported 


Indeterminate results (index test): None reported 


Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 


Comparative 


Notes Funding: FIND 


Publication status: published 


Source: FIND website/IFU for index test 


Author COI: None stated (these are independent evaluations) 


Methodological quality 


Item Authors' judgement 


DOMAIN 1: Patient Selection 


Was a consecutive or random sample of Yes 
patients enrolled? 


Was a case-control design avoided? Yes 
Did the study avoid inappropriate exclu- Yes 
sions? 
Did the study avoid inappropriate inclu- Yes 
sions? 


Could the selection of patients have in- 
troduced bias? 


Are there concerns that the included pa- 
tients and setting do not match the re- 
view question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test results interpreted Yes 
without knowledge of the results of the ref- 
erence standard? 


If a threshold was used, was it pre-speci- Yes 
fied? 


Could the conduct or interpretation of 
the index test have introduced bias? 


Are there concerns that the index test, 
its conduct, or interpretation differ from 
the review question? 


Risk of bias Applicability concerns 


Low risk 


Low concern 


Low risk 


Low concern 
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FIND 2020d (DE) (continued) 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correct- 
ly classify the target condition? 


Were the reference standard results inter- 
preted without knowledge of the results of 
the index tests? 


Reference standard does not incorporate 
result of index test? 


Could the reference standard, its con- 
duct, or its interpretation have intro- 
duced bias? 


Are there concerns that the target con- 
dition as defined by the reference stan- 
dard does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between 
index test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Did all participants receive a reference 
standard? 


Were results presented per patient? 


Could the patient flow have introduced 
bias? 


FIND 2020e (BR) 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


No 


Yes 


Yes 


Yes 


Yes 


Yes 


Yes 


Yes 


High risk 


High 


Low risk 


Single group study to estimate sensitivity and specificity; this extraction is for 
data from Brazil (see FIND 2020e (DE) for extraction of data from other site): 

- adults in community meeting national suspect definition for COVID-19 testing 
presenting at a community testing clinic (n=476) 


Recruitment: Consecutive recruitment 
Prospective or retrospective: Prospective 
Setting: Community testing clinic 


Location: Marica, state of Rio de Janeiro 
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FIND 2020e (BR) (Continued) 


Index tests 


Target condition and reference standard(s) 


Flow and timing 


Country: Brazil 

Dates: 27 Jul to 16 Sep 

Symptoms and severity: 470/476 (99%) symptomatic; no further details 
Demographics: mean age 45 y (0-106 y) (473 participants); 252 male (53%) 


Exposure history: Not stated 


Test name: BIOCREDIT COVID-19 Ag (G61RHA20) 
Manufacturer: RapiGEN Inc 

Antibody: Not reported 

Antigen target: Not reported 

Test method: LFA (CGIA, from IFU) 

Samples used: NP; collected by HCW 

Transport media: Assay diluent provided by manufacturer 


Sample storage: Author contact advises tested as soon as possible and within 
the time limit specified in the IFU 


Test operator: HCW 
Definition of test positivity: Visual appearance of test and control lines 
Blinding reported: Yes 


Timing of samples: median 5 days p.s.o (IQR 4, 7 days) (for 470 patients). Day <0 
to 3 - 95, 20%; day 4 to 7 - 296, 63%; day >=8 - 79, 17% 


Reference standard: RT-PCR; Lab-developed assay based on the US CDC proto- 
col. 
Ct threshold not stated; author contact advises Ct thresholds as per assay IFUs 


Definition of non-COVID cases: Same as for cases. Single negative PCR required 
for absence of infection 


Genetic target(s): N1 and N2 
Samples used: NP swabs 


Timing of reference standard: Not stated; author contact advises only paired 
swabs used. 


Blinded to index test: Yes 


Incorporated index test: No 


Time interval between index and reference tests: Paired swabs; 0 to several days 
based on PCR turnaround times at the lab 


All patients received same reference standard: Yes 
Missing data: Reports 0 missing data 
Uninterpretable results: None reported 
Indeterminate results (index test): None reported 


Indeterminate results (reference standard): None reported 
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FIND 2020e (BR) (Continued) 





Unit of analysis: Patients 
Comparative 


Notes Funding: FIND 
Publication status: published 
Source: FIND website/IFU for index test 


Author COI: None stated (these are independent evaluations) 
Methodological quality 
Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of patients Yes 
enrolled? 


Was a case-control design avoided? Yes 
Did the study avoid inappropriate exclusions? Yes 
Did the study avoid inappropriate inclusions? Yes 


Could the selection of patients have introduced Low risk 
bias? 


Are there concerns that the included patients Low concern 
and setting do not match the review question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test results interpreted without Yes 

knowledge of the results of the reference stan- 

dard? 

If a threshold was used, was it pre-specified? Yes 

Could the conduct or interpretation of the in- Low risk 


dex test have introduced bias? 

Are there concerns that the index test, its con- Low concern 
duct, or interpretation differ from the review 

question? 

DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly clas- No 
sify the target condition? 





Were the reference standard results interpret- Yes 
ed without knowledge of the results of the index 
tests? 
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FIND 2020e (BR) (Continued) 





Reference standard does not incorporate result of Yes 
index test? 


Could the reference standard, its conduct, or High risk 
its interpretation have introduced bias? 


Are there concerns that the target condition High 
as defined by the reference standard does not 
match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between index Yes 
test and reference standard? 


Did all patients receive the same reference stan- Yes 
dard? 
Were all patients included in the analysis? Yes 


Did all participants receive a reference standard? _— Yes 
Were results presented per patient? Yes 


Could the patient flow have introduced bias? Low risk 


FIND 2020e (DE) 


Study characteristics 


Patient Sampling Single group study to estimate sensitivity and specificity at two sites; this extraction is 
for data from Germany (see FIND 2020e (BR) for extraction of data from other site): 
- adults in community meeting national suspect definition for COVID-19 testing pre- 
senting at 
[1] a drive-in testing centre or 
[2] ambulatory testing clinic 


Recruitment: Consecutive recruitment 


Prospective or retrospective: Prospective 


Patient characteristics and setting Setting: Community 


Location: [1] Heidelberg drive in testing; [2] Berlin: Ambulatory testing clinic of Charité 
- University Hospital 


Country: Germany 

Dates: [1] Heidelberg: 4 May - 3 Sept; [2] Berlin: 4 May - 18 Aug 

Symptoms and severity: 733/1223 symptomatic; no further details 
Demographics: mean age 39.5 y (17,59.2 y) (1239 participants); 607 male (50%) 


Exposure history: Not stated 


Index tests Test name: BIOCREDIT COVID-19 Ag (G61RHA20) 
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FIND 2020e (DE) (Continued) 





Manufacturer: RapiGEN Inc 

Antibody: Not reported 

Antigen target: Not reported 

Test method: LFA (CGIA, from IFU) 

Samples used: [1] NP; [2] NOP; collected by HCW 
Transport media: Assay diluent provided by manufacturer 


Sample storage: Author contact advises tested as soon as possible and within the time 
limit specified in the IFU 


Test operator: HCW 
Definition of test positivity: Visual appearance of test and control lines 
Blinding reported: Yes 


Timing of samples: median 3 days p.s.o (IQR 2,4days) (for 701 patients). Day <0 to 3 - 
472, 67%; day 4 to 7 - 161, 23%; day >=8 - 68, 10% 


Target condition and reference standard(s) | Reference standard: RT-PCR; one of 5 assays: 
1. Cobas SARS-CoV-2 (Roche Diagnostics Inc); N = 344 
2. Abbott RealTime SARS-CoV-2 (Abbott Molecular, Inc) N= 114 
3. Allplex 2019-nCov Assay (Seegene Inc); N=571 
4. LightMix® Modular SARS-CoV (COVID19) E-gene (Tib Molbiol); N = 132 
5. RealStar® SARS-CoV-2 RT-PCR Kit (Altona Diagnostics); N = 80 
Ct thresholds not stated; author contact advises Ct thresholds as per assay IFUs 


Definition of non-COVID cases: Same as for cases. Single negative PCR required for ab- 
sence of infection 


Genetic target(s): Not stated 
Samples used: NP swabs 


Timing of reference standard: Not stated; author contact advises only paired swabs 
used. 


Blinded to index test: Yes 


Incorporated index test: No 


Flow and timing Time interval between index and reference tests: Paired swabs; 0 to several days based 
on PCR turnaround times at the lab 


All patients received same reference standard: Yes 

Missing data: Reports 0 missing data 

Uninterpretable results: None reported 

Indeterminate results (index test): None reported 
Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 
Comparative 


Notes Funding: FIND 
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FIND 2020e (DE) (Continued) 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of 
patients enrolled? 


Was a case-control design avoided? 


Did the study avoid inappropriate exclu- 
sions? 


Did the study avoid inappropriate inclu- 
sions? 


Could the selection of patients have in- 
troduced bias? 


Are there concerns that the included pa- 
tients and setting do not match the re- 
view question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test results interpreted 
without knowledge of the results of the ref- 
erence standard? 


If a threshold was used, was it pre-speci- 
fied? 


Could the conduct or interpretation of 
the index test have introduced bias? 


Are there concerns that the index test, 
its conduct, or interpretation differ from 
the review question? 


Publication status: published 


Source: FIND website/IFU for index test 


Author COI: None stated (these are independent evaluations) 


Authors' judgement 


Yes 


Yes 


Yes 


Yes 


Yes 


Yes 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correct- 
ly classify the target condition? 


Were the reference standard results inter- 
preted without knowledge of the results of 
the index tests? 


No 


Yes 


Risk of bias 


Low risk 


Low risk 


Applicability concerns 


Low concern 


Low concern 





Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 


Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 


Collaboration. 


127 


Trusted evidence. 


Cochra ne 
Library 


Better health. 


© 


Informed decisions. 


Cochrane Database of Systematic Reviews 





FIND 2020e (DE) (continued) 


Reference standard does not incorporate 


result of index test? 


Could the reference standard, its con- 
duct, or its interpretation have intro- 
duced bias? 


Are there concerns that the target con- 


dition as defined by the reference stan- 


dard does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between 


index test and reference standard? 


Did all patients receive the same reference 


standard? 


Were all patients included in the analysis? 


Did all participants receive a reference 
standard? 


Were results presented per patient? 


Could the patient flow have introduced 


bias? 


Fourati 2020 [A] 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Yes 


High risk 


High 


Yes 


Yes 


Yes 


Yes 


Yes 


Low risk 


Two group study to estimate sensitivity and specificity: 

(1) residual samples from subjects with positive SARS-CoV-2 PCR tested when they pre- 
sented symptoms at the time of the first epidemic wave (n=297) 

(2) pre-pandemic samples (n=337) 


Recruitment: Random (stratified by Ct and time pso) 


Prospective or retrospective: Retrospective 


Setting: Mixed; likely outpatient and in-patient "consulted or were admitted" 
Location: Henri Hospital Mondor de Créteil 

Country: France 

Dates: March 9 to April 9, 2020. 


Symptoms and severity: Not stated; all apparently symptomatic 
Data by viral load reported for 293/297 cases: <=20 Ct - 39, 13%; 20 to 25 Ct - 88, 30%; 25 to 
30 Ct - 72, 25%; >30 Ct - 88, 30% 


Demographics: Not stated 


Exposure history: Not stated 
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Fourati 2020 [A] (continued) 





Index tests Comparative study of six Ag tests (no product codes reported); Fourati 2020 [A] data relate 
to test [A], see additional entries for tests [B] to [E] 


[A] SARS-CoV-2 COVID-19 Respi-Strip 

[B] Standard Q COVID-19 Ag 

[C] PanBio COVID-19 Antigen Rapid Test 

[D] Biosynex COVID-19 Ag BSS 

[E] COVID-VIRO Antigen Rapid Test 

[F] NG Test SARS-CoV-2 Ag (assay excluded from review due to Vortex requirement as stat- 
ed in IFU) 

(no product codes reported) 


Manufacturer: 

[A] Coris BioConcept, Gembloux, Belgium [B] SD BIOSENSOR, Inc., Korea 
[C] Abbott, Chicago, Illinois, USA 

[D] Biosynex, Strasbourg, France 


[E] AAZ, Boulogne-Billancourt, France 
[F] NG Biotech, Guipry, France 


Antibody: Not stated 

Antigen target: Not stated 

Test method: Not stated 

Samples used: NP; collection not reported 

Transport media: VTM (Cepheid?® or Deltalab®); 100 uL used for testing 
Sample storage: frozen at -80 °C until use 

Test operator: Laboratory staff 

Definition of test positivity: Visual, as per manufacturer. 


Blinding reported: Yes; each test was interpreted independently by two different laborato- 
ry technicians. A third reading was carried out in the event of discrepancy 


Timing of samples: post-symptom onset (reported for 289 samples): 0-3 days 97, 34%; 4-7 


days 103, 36%; 8=11 days 63, 22%; >=12 days 26, 9% 
No. samples reported at >7 days varied per test, maximum was 289 


Target condition and reference stan- Reference standard: RT-PCR; in-house assay developed by CNR (Institut Paster) or RealStar 
dard(s) SARS-CoV-2 (Altona Diagnostics, Germany) 


Definition of non-COVID cases: Pre-pandemic 

Genetic target(s): Not stated 

Samples used: NP; same as for index 

Timing of reference standard: As for index 

Blinded to index test: Yes, seems to be at time of sampling 


Incorporated index test: No 


Flow and timing Time interval between index and reference tests: Same swab; simultaneous 
All patients received same reference standard: Yes 


Missing data: Number of cases missing per assay varied; reasons for missing data not re- 
ported (presumably invalid assay results) 
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Fourati 2020 [A] (continued) 


Comparative 


Notes 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample 
of patients enrolled? 


Was a case-control design avoided? 


Did the study avoid inappropriate ex- 
clusions? 


Did the study avoid inappropriate in- 
clusions? 


Could the selection of patients have 


introduced bias? 


Are there concerns that the includ- 


ed patients and setting do not match 


the review question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test results interpret- 


ed without knowledge of the results of 


the reference standard? 


If a threshold was used, was it pre- 
specified? 


[A] 5, 1.7% 

[B] 6, 2.0% 

[C] 2, 0.7% 

[D] 0 

[E] 2, 0.7% 

[F]0 

Uninterpretable results: Not stated 

Indeterminate results (index test): Not stated 
Indeterminate results (reference standard): Not stated 


Unit of analysis: Presume patients 


Funding: Evaluation of [A] and [B] conducted in collaboration with Médecins sans Fron- 
tiéres and Epicenter 


Publication status: Published 
Source: Laboratory report obtained via SFM Microbiologie website 


Author COI: No COI present 


Authors' judgement Risk of bias Applicability concerns 


Yes 


No 


Unclear 
Unclear 
High risk 


High 


Yes 


Yes 
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Fourati 2020 [A] (Continued) 


Could the conduct or interpretation 
of the index test have introduced 
bias? 


Are there concerns that the index 
test, its conduct, or interpretation 
differ from the review question? 


Low risk 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to cor- 
rectly classify the target condition? 


Were the reference standard results in- 
terpreted without knowledge of the re- 
sults of the index tests? 


Reference standard does not incorpo- 
rate result of index test? 


Could the reference standard, its 
conduct, or its interpretation have 
introduced bias? 


Are there concerns that the target 
condition as defined by the refer- 
ence standard does not match the 
question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval be- 
tween index test and reference stan- 
dard? 


Did all patients receive the same refer- 
ence standard? 


Were all patients included in the analy- 
sis? 


Did all participants receive a reference 
standard? 


Were results presented per patient? 


Could the patient flow have intro- 
duced bias? 


Fourati 2020 [B] 


Study characteristics 


Yes 


Yes 


Yes 


Low risk 


Yes 


Yes 


No 


Yes 


Yes 


High risk 


High 


High 
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Fourati 2020 [B] (continued) 


Patient Sampling 


Patient characteris- 
tics and setting 


Index tests 


Target condition 
and reference stan- 
dard(s) 


Flow and timing 


Comparative 


Notes 


Comparative study of six Ag tests (no product codes reported); Fourati 2020 [A] reports full study characteris- 
tics and QUADAS 


Comparative study of six Ag tests (no product codes reported); Fourati 2020 [B] relates to test [B] in the list be- 
low; see Fourati 2020 [A] for full study characteristics and QUADAS entries 


[A] SARS-CoV-2 COVID-19 Respi-Strip 

[B] Standard Q COVID-19 Ag 

[C] PanBio COVID-19 Antigen Rapid Test 

[D] Biosynex COVID-19 Ag BSS 

[E] COVID-VIRO Antigen Rapid Test 

[F] NG Test SARS-CoV-2 Ag (assay excluded from review due to Vortex requirement as stated in IFU) 
(no product codes reported) 


Manufacturer: 


[A] Coris BioConcept, Gembloux, Belgium 
[B] SD BIOSENSOR, Inc., Korea 

[C] Abbott, Chicago, Illinois, USA 

[D] Biosynex, Strasbourg, France 

[E] AAZ, Boulogne-Billancourt, France 

[F] NG Biotech, Guipry, France 


Antibody: Not stated 

Antigen target: Not stated 

Test method: Not stated 

Samples used: NP; collection not reported 

Transport media: VTM (Cepheid® or Deltalab®); 100 uL used for testing 
Sample storage: frozen at -80 °C until use 

Test operator: Laboratory staff 

Definition of test positivity: Visual, as per manufacturer. 


Blinding reported: Yes; each test was interpreted independently by two different laboratory technicians. A 
third reading was carried out in the event of discrepancy 


Timing of samples: post-symptom onset (reported for 289 samples): 0-3 days 97, 34%; 4-7 days 103, 36%; 8=11 
days 63, 22%; >=12 days 26, 9% 
No. samples reported at >7 days varied per test, maximum was 289 


Comparative study of six Ag tests (no product codes reported); Fourati 2020 [A] reports full study characteris- 
tics and QUADAS 


Comparative study of six Ag tests (no product codes reported); Fourati 2020 [A] reports full study characteris- 
tics and QUADAS 
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Fourati 2020 [C] 


Study characteristics 


Patient Sampling 


Patient characteris- 
tics and setting 


Index tests 


Target condition 
and reference stan- 
dard(s) 


Flow and timing 


Comparative 


Notes 


Comparative study of six Ag tests (no product codes reported); Fourati 2020 [A] reports full study characteris- 
tics and QUADAS 


Comparative study of six Ag tests (no product codes reported); Fourati 2020 [A] reports full study characteris- 
tics and QUADAS 





Comparative study of six Ag tests (no product codes reported); Fourati 2020 [C] relates to test [C] in the list be- 
low; see Fourati 2020 [A] for full study characteristics and QUADAS entries 


[A] SARS-CoV-2 COVID-19 Respi-Strip 

[B] Standard Q COVID-19 Ag 

[C] PanBio COVID-19 Antigen Rapid Test 

[D] Biosynex COVID-19 Ag BSS 

[E] COVID-VIRO Antigen Rapid Test 

[F] NG Test SARS-CoV-2 Ag (assay excluded from review due to Vortex requirement as stated in IFU) 


Manufacturer: 


[A] Coris BioConcept, Gembloux, Belgium 
{B] SD BIOSENSOR, Inc., Korea 

[C] Abbott, Chicago, Illinois, USA 

[D] Biosynex, Strasbourg, France 

[E] AAZ, Boulogne-Billancourt, France 

[F] NG Biotech, Guipry, France 


Antibody: Not stated 

Antigen target: Not stated 

Test method: Not stated 

Samples used: NP; collection not reported 

Transport media: VTM (Cepheid® or Deltalab®); 100 uL used for testing 
Sample storage: frozen at -80 °C until use 

Test operator: Laboratory staff 

Definition of test positivity: Visual, as per manufacturer. 


Blinding reported: Yes; each test was interpreted independently by two different laboratory technicians. A 
third reading was carried out in the event of discrepancy 


Timing of samples: post-symptom onset (reported for 289 samples): 0-3 days 97, 34%; 4-7 days 103, 36%; 8=11 
days 63, 22%; >=12 days 26, 9% 
No. samples reported at >7 days varied per test, maximum was 289 


Comparative study of six Ag tests (no product codes reported); Fourati 2020 [A] reports full study characteris- 
tics and QUADAS 


Comparative study of six Ag tests (no product codes reported); Fourati 2020 [A] reports full study characteris- 
tics and QUADAS 
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Fourati 2020 [D] 


Study characteristics 


Patient Sampling 


Patient characteris- 
tics and setting 


Index tests 


Target condition 
and reference stan- 
dard(s) 


Flow and timing 


Comparative 


Comparative study of six Ag tests (no product codes reported); Fourati 2020 [A] reports full study characteris- 
tics and QUADAS 


Comparative study of six Ag tests (no product codes reported); Fourati 2020 [A] reports full study characteris- 
tics and QUADAS 





Comparative study of six Ag tests (no product codes reported); Fourati 2020 [D] relates to test [D] in the list be- 
low; see Fourati 2020 [A] for full study characteristics and QUADAS entries 


[A] SARS-CoV-2 COVID-19 Respi-Strip 

[B] Standard Q COVID-19 Ag 

[C] PanBio COVID-19 Antigen Rapid Test 

[D] Biosynex COVID-19 Ag BSS 

[E] COVID-VIRO Antigen Rapid Test 

[F] NG Test SARS-CoV-2 Ag (assay excluded from review due to Vortex requirement as stated in IFU) 


Manufacturer: 


[A] Coris BioConcept, Gembloux, Belgium 
[B] SD BIOSENSOR, Inc., Korea 

[C] Abbott, Chicago, Illinois, USA 

[D] Biosynex, Strasbourg, France 

[E] AAZ, Boulogne-Billancourt, France 

[F] NG Biotech, Guipry, France 


Antibody: Not stated 

Antigen target: Not stated 

Test method: Not stated 

Samples used: NP; collection not reported 

Transport media: VTM (Cepheid® or Deltalab®); 100 uL used for testing 
Sample storage: frozen at -80 °C until use 

Test operator: Laboratory staff 

Definition of test positivity: Visual, as per manufacturer. 


Blinding reported: Yes; each test was interpreted independently by two different laboratory technicians. A 
third reading was carried out in the event of discrepancy 


Timing of samples: post-symptom onset (reported for 289 samples): 0-3 days 97, 34%; 4-7 days 103, 36%; 8=11 
days 63, 22%; >=12 days 26, 9% 
No. samples reported at >7 days varied per test, maximum was 289 


Comparative study of six Ag tests (no product codes reported); Fourati 2020 [A] reports full study characteris- 
tics and QUADAS 


Comparative study of six Ag tests (no product codes reported); Fourati 2020 [A] reports full study characteris- 
tics and QUADAS 
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Fourati 2020 [D] (continued) 


Notes 


Fourati 2020 [E] 


Study characteristics 
Patient Sampling 
Patient characteris- 
tics and setting 


Index tests 


Target condition 
and reference stan- 
dard(s) 


Comparative study of six Ag tests (no product codes reported); Fourati 2020 [A] reports full study characteris- 
tics and QUADAS 


Comparative study of six Ag tests (no product codes reported); Fourati 2020 [A] reports full study characteris- 
tics and QUADAS 


Comparative study of six Ag tests (no product codes reported); Fourati 2020 [E] relates to test [E] in the list be- 
low; see Fourati 2020 [A] for full study characteristics and QUADAS entries 


[A] SARS-CoV-2 COVID-19 Respi-Strip 

[B] Standard Q COVID-19 Ag 

[C] PanBio COVID-19 Antigen Rapid Test 

[D] Biosynex COVID-19 Ag BSS 

[E] COVID-VIRO Antigen Rapid Test 

[F] NG Test SARS-CoV-2 Ag (assay excluded from review due to Vortex requirement as stated in IFU) 


Manufacturer: 


[A] Coris BioConcept, Gembloux, Belgium 
[B] SD BIOSENSOR, Inc., Korea 

[C] Abbott, Chicago, Illinois, USA 

[D] Biosynex, Strasbourg, France 

[E] AAZ, Boulogne-Billancourt, France 
[F] NG Biotech, Guipry, France 


Antibody: Not stated 

Antigen target: Not stated 

Test method: Not stated 

Samples used: NP; collection not reported 

Transport media: VTM (Cepheid® or Deltalab®); 100 UL used for testing 
Sample storage: frozen at -80 °C until use 

Test operator: Laboratory staff 

Definition of test positivity: Visual, as per manufacturer. 


Blinding reported: Yes; each test was interpreted independently by two different laboratory technicians. A 
third reading was carried out in the event of discrepancy 


Timing of samples: post-symptom onset (reported for 289 samples): 0-3 days 97, 34%; 4-7 days 103, 36%; 8=11 
days 63, 22%; >=12 days 26, 9% 
No. samples reported at >7 days varied per test, maximum was 289 


Comparative study of six Ag tests (no product codes reported); Fourati 2020 [A] reports full study characteris- 
tics and QUADAS 
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Fourati 2020 [E] (Continued) 





Flow and timing Comparative study of six Ag tests (no product codes reported); Fourati 2020 [A] reports full study characteris- 
tics and QUADAS 


Comparative 


Notes 


Ghofrani 2020 


Study characteristics 


Patient Sampling Single group study to estimate sensitivity and specificity in patients with both RT- 
PCR and POCT results available (n=113), including: 
[1] symptomatic patients with a PCR swab test close to presentation and a re-swab 
for POC testing, 
[2] patients with positive RT-PCR results and remnant NP swabs available for POC 
test, 
[3] asymptomatic patients with positive POC result on admission who were re- 
swabbed for RT-PCR confirmation. 
N per group was not reported 


Recruitment: Convenience 


Prospective or retrospective: Retrospective 


Patient characteristics and setting Setting: Unclear; primarily in-patients? 


Location: PeaceHealth Medical Group (10 hospitals and numerous clinics serving 
suburban and rural communities in three states) 


Country: USA 

Dates: April 6- April 21 2020 

Symptoms and severity: Majority’ symptomatic, no further details. 
Demographics: Not stated 


Exposure history: Not stated 


Index tests Test name: ID NOW COVID-19 assay (no product code reported) 
Manufacturer: Abbott Laboratories 
Target gene(s): RdRp region 
Antigen target: n/a 
Test method: Isothermal PCR 


Samples used: Nasal 58 (51.3%), NP 33 (29.2%), not stated 22 (19.5%). 
Direct testing 58 (51.3%), UTM 26 (23.0%); not stated 29 (25.7%). 


Transport media: None or UTM; no further details 
Sample storage: Not stated 
Test operator: Not stated; infer laboratory staff. 


Definition of test positivity: Not stated; presume as per manufacturer 
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Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Cochrane Database of Systematic Reviews 





Blinding reported: Not stated 


Timing of samples: Not stated; implies mostly close to presentation 


Reference standard: RT-PCR; not described (conducted at one of two commercial 
laboratories, one of two State Public Health laboratories, an academic medical cen- 
ter, or tested in-house) 


Definition of non-COVID cases: Same as index test; infer single negative 
Genetic target(s): not stated 


Samples used: Mixed; either paired swabs (within 3 days of each other) or same 
samples used 


Timing of reference standard: Not stated 


Blinded to index test: unclear; probably mixed depending on where RT-PCR was 
conducted 


Incorporated index test: No 


Time interval between index and reference tests: Some same sample; paired sam- 
ples could be up to 3 days apart 


All patients received same reference standard: Yes 

Missing data: None reported 

Uninterpretable results: None reported 

Indeterminate results (index test): None reported 
Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 


Funding: No funding received 
Publication status: Published 
Source: Unclear 


Author COI: none reported 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
Was a consecutive or random sample of pa- No 
tients enrolled? 
Was a case-control design avoided? Unclear 
Did the study avoid inappropriate exclusions? Unclear 
Did the study avoid inappropriate inclusions? No 
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Ghofrani 2020 (continued) 
Could the selection of patients have intro- 
duced bias? 


Are there concerns that the included pa- 
tients and setting do not match the review 
question? 


DOMAIN 2: Index Test (Antigen tests) 


DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test results interpreted with- 
out knowledge of the results of the reference 
standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the 
index test have introduced bias? 


Are there concerns that the index test, its 
conduct, or interpretation differ from the 
review question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly 
classify the target condition? 


Were the reference standard results interpret- 
ed without knowledge of the results of the in- 
dex tests? 


Reference standard does not incorporate re- 
sult of index test? 


Could the reference standard, its conduct, 
or its interpretation have introduced bias? 


Are there concerns that the target condi- 
tion as defined by the reference standard 
does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between in- 
dex test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Did all participants receive a reference stan- 
dard? 


Were results presented per patient? 


High risk 


Unclear 


Yes 


Unclear risk 


No 


Unclear 


Yes 


High risk 


No 


Yes 


Unclear 


Yes 


Yes 


High 


High 


High 
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Ghofrani 2020 (continued) 


Could the patient flow have introduced High risk 


bias? 


Gibani 2020 


Study characteristics 


Patient Sampling 


Patient characteristics and 
setting 


Single group study to estimate sensitivity and specificity with three sources of participants: 

[1] self-referred, health-care workers or their family members with suspected COVID-19 who were 
not admitted to hospital (n=280) 

[2] emergency department patients with suspected COVID-19 (n=15) 

[3] hospital inpatient admissions with or without suspected COVID-19 (n=91) 

Total N was 418 paired samples; 32 excluded as invalid (patient group not reported), 24 invalid on 
DnaNudge and 8 on RT-PCR) 


Recruitment: [1] and [2] Not reported; [3] consecutive 


Prospective or retrospective: Prospective 


Setting: Mixed ([1] community, [2] A&E, [3] Inpatient) 


Location: [1] St Mary’s Hospital and the John Radcliffe Hospital, [2] St Mary’s Hospital, [3] Chelsea & 
Westminster Hospital 


Country: London or Oxford, UK 

Dates: [1] April 10 to May 12, [2] April 2 to 24, [3] May 12 to 18 
Symptoms and severity: Only group [3] were inpatient 
Demographics: median age 46 y (IQR 31-66); 124, 32% male 


Exposure history: Not reported 





Index tests Test name: CovidNudge (no product code) 

Manufacturer: DnaNudge, UK 
Antibody: rdrp1, rdrp2, e-gene, n-gene, n1, n2, and n3 
Antigen target: n/a 
Test method: Automated RT-PCR; Described as "integrated lab-on-chip device that enables sam- 
ple-to-result (RT-)PCR" 
Samples used: NP; HCW obtained swabs using pediatric swab 
Transport media: None 
Sample storage: No delay reported 
Test operator: Unclear; possibly HCW 
Definition of test positivity: at least two replicates of at least one viral gene target amplified 
Blinding reported: Yes; results from CovidNudge testing reported before laboratory results were 
available 
Timing of samples: On presentation; timing not reported 
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Gibani 2020 (continued) 


Target condition and refer- 
ence standard(s) 


Flow and timing 


Comparative 


Notes 


Reference standard: SARS-CoV-2 RT-PCR; assay varied by site. 

A. AusDiagnostics MT-PCR (Orflab, Orf8); n=74 

b. Roche RT-PCR (Orflab, E); N=81 

c. Abbott RT-PCR (RdRp, N); n=66 

d. ThermoFisher (orflab, the spike (S) gene and the nucleocapsid (N) gene); n=21 
e. PHE in-house RT-PCR (RdRp); n=120 

f. Imperial Molecular Diagnostics Unit (E); n=24 


Definition of non-COVID cases: As above (single negative) 
Genetic target(s): See above 

Samples used: NOP (paired) 

Timing of reference standard: Not stated 


Blinded to index test: Yes; centralised laboratory testing and point-of-care testing were done by 
separate staff members. Staff doing the centralised laboratory testing were masked to the point of- 
care test results and vice-versa 


Incorporated index test: No 


Time interval between index and reference tests: Simultaneous (paired) 
All patients received same reference standard: Yes (different assays) 
Missing data: Additional 47 samples not 'paired'; not collected on same date 


Uninterpretable results: 32 samples excluded; 24 invalid on DNANudge (failed to amplify RNaseP; 
22/24 with associated RT-PCR result were negative) and 8 on RT-PCR (all 8 from one site) 


Indeterminate results (index test): None reported 
Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 


Funding: Supported by the National Institute for Health Research (NIHR) Imperial NHS Trust Bio- 
medical Research Centre (London, Uk). Part of this work was supported by the NIHR Health Pro- 
tection Research Unit in Healthcare Associated Infections and Antimicrobial Resistance at Ox- 
ford University (Oxford, UK) in partnership with Public Health England (grant HPRU-2012-10041). 
DnaNudge supplied the test cartridges and NudgeBox processing units. 


Publication status: Published 
Source: Lancet Microbe 


Author COI: CT, RS, MS, MK, T-KH, SDM, K-YFL, JB, and AO are employees of DnaNudge. CT is the co- 
inventor of the DnaNudge CovidNudge system and is named on the patent for the method and ap- 
paratus for analysing biological specimens on the DnaNudge platform (US Patent No: US 10 093 
965.B2).16 LSPM has consulted for bioMerieux (2013-20), DNAelectronics (2015), Dairy Crest (2017- 
18), Pfizer (2018-20), and Umovis Lab (2020), received speaker fees from Profile Pharma (2018), 
received research grants from the UK National Institute for Health Research (NIHR; 2013-2019), 
Leo Pharma (2016), and CW+ Charity (2018-19), and received educational support from Eumedica 
(2016-17). NM has received speaker fees from Beyer (2016) and Pfizer (2019), and received educa- 
tional support from Eumedica (2016) and Baxter (2017). MMG and GC are partly supported by the 
NIHR Imperial Biomedical Research Centre. GC is an NIHR research professor and investigator with- 
in the NIHR London in-vitro diagnostic co-operative. All other authors declare no competing inter- 
ests. 
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Gibani 2020 (continued) 





Methodological quality 
Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 


Was a consecutive or random Unclear 
sample of patients enrolled? 


Was a case-control design Yes 
avoided? 
Did the study avoid inappro- Yes 


priate exclusions? 


Did the study avoid inappro- Yes 
priate inclusions? 


Could the selection of pa- Unclear risk 
tients have introduced bias? 


Are there concerns that the Low concern 
included patients and set- 

ting do not match the review 

question? 


DOMAIN 2: Index Test (Antigen tests) 
DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test results in- Yes 
terpreted without knowledge 

of the results of the reference 
standard? 


If athreshold was used, was it Yes 
pre-specified? 


Could the conduct or inter- Low risk 
pretation of the index test 
have introduced bias? 


Are there concerns that the Unclear 
index test, its conduct, or in- 

terpretation differ from the 

review question? 


DOMAIN 3: Reference Standard 


Is the reference standards like- No 
ly to correctly classify the tar- 
get condition? 


Were the reference standard Yes 
results interpreted without 
knowledge of the results of the 

index tests? 
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Gibani 2020 (continued) 


Reference standard does not 
incorporate result of index 
test? 


Could the reference stan- 
dard, its conduct, or its inter- 
pretation have introduced 
bias? 


Are there concerns that the 
target condition as defined 
by the reference standard 
does not match the ques- 
tion? 


DOMAIN 4: Flow and Timing 
Was there an appropriate in- 
terval between index test and 


reference standard? 


Did all patients receive the 
same reference standard? 


Were all patients included in 
the analysis? 


Did all participants receive a 
reference standard? 


Were results presented per pa- 
tient? 


Could the patient flow have 
introduced bias? 


Goldenberger 2020 


Study characteristics 


Patient Sampling 


Yes 


Yes 


Yes 


No 


Yes 


Yes 


Patient characteristics and setting 


High risk 


High 


High risk 


Design unclear but appears to be a two group study to estimate sensitivity 
and specificity: 

[1] SARS-CoV-2 positive samples selected to reflect a broad range of Ct values 
(n=10) 

[2] SARS-CoV-2 negative samples (n=9) 

Groups [1] and [2] from patients suspected of COVID-19 undergoing routine 
diagnostics within a one week period 

[third cohort of pre-pandemic samples positive for other coronaviruses re- 
ported but not included in review (n=8)] 


Recruitment: Convenience 


Prospective or retrospective: Unclear 


Setting: Unclear 


Location: University Hospital Basel 
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Goldenberger 2020 (continued) 


Index tests 


Target condition and reference standard(s) 


Flow and timing 


Country: Switzerland 

Dates: One week during 2020 pandemic 
Symptoms and severity: Not reported 
Demographics: Not reported 


Exposure history: Not reported 


Test name: Xpert Xpress (no product code) 
Manufacturer: Cepheid Inc 

Antibody: E, N2 

Antigen target: n/a 

Test method: Automated RT-PCR 

Samples used: NP 

Transport media: UTM or eSwab media (Copan) 


Sample storage: frozen at -80 °C until batch-wise sample processing with the 
Xpert 


Test operator: laboratory technician 
Definition of test positivity: Not stated; both targets reported in all samples 
Blinding reported: Unclear 


Timing of samples: Not stated 


Reference standard: Roche cobas RT-PCR; threshold not reported but all posi- 
tive samples <33 Ct 


Definition of non-COVID cases: [2] COVID-19 suspects; as for cases (single 
negative PCR) 


Genetic target(s): E, ORF1 

Samples used: NP (same as index) 
Timing of reference standard: Not stated 
Blinded to index test: Yes, conducted first 


Incorporated index test: Not stated 


Time interval between index and reference tests: Simultaneous (same swab) 
All patients received same reference standard: Yes 

Missing data: None reported, no participant flow diagram reported 
Uninterpretable results: None reported 

Indeterminate results (index test): None reported 

Indeterminate results (reference standard): None reported 


Unit of analysis: Unclear 
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Goldenberger 2020 (continued) 


Comparative 


Notes 


Methodological quality 


Item 


DOMAIN 1: Patient Selection 


Was a consecutive or random sample of patients en- 
rolled? 


Was a case-control design avoided? 
Did the study avoid inappropriate exclusions? 
Did the study avoid inappropriate inclusions? 


Could the selection of patients have introduced 
bias? 


Are there concerns that the included patients and 
setting do not match the review question? 


DOMAIN 2: Index Test (Antigen tests) 
DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test results interpreted without 
knowledge of the results of the reference standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the index 
test have introduced bias? 


Are there concerns that the index test, its con- 
duct, or interpretation differ from the review 
question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly classify 
the target condition? 


Were the reference standard results interpreted 
without knowledge of the results of the index tests? 


Reference standard does not incorporate result of 
index test? 


Funding: None reported 
Publication status: Published 
Source: Journal of Virological Methods 


Author COI: None reported 


Authors' judgement Risk of bias 


No 


No 
Unclear 
Unclear 


High risk 


Unclear 


Unclear 


Unclear risk 


No 


Yes 


Yes 


Applicability con- 
cerns 


High 


High 
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Goldenberger 2020 (continued) 


Could the reference standard, its conduct, or its High risk 


interpretation have introduced bias? 


Are there concerns that the target condition as High 
defined by the reference standard does not match 


the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between index Yes 


test and reference standard? 


Did all patients receive the same reference stan- Yes 

dard? 

Were all patients included in the analysis? Unclear 

Did all participants receive a reference standard? Yes 

Were results presented per patient? Unclear 

Could the patient flow have introduced bias? Unclear risk 


Gremmels 2020(a) 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Index tests 


Report of two cohorts of patients presenting for COVID-19 testing. Gremmels 2020(a) en- 
try relates to: 

[1] community-dwelling mildly symptomatic subjects in a medium endemic area 
(n=1369) 


Gremmels 2020(b) entry reports data for second cohort in a high endemic area 
Recruitment: Yes; all individuals invited to participate 


Prospective or retrospective: Prospective 


Setting: Community testing centre 

Location: [1] University Medical Center Utrecht (UMCU) 
Country: Netherlands 

Dates: [1] Sep 22 to Oct 6 


Symptoms and severity: Cohort [1] only. Data on symptoms were missing from nine sub- 
jects 

Asymptomatic 37, 2.7%, Sore throat 907, 66.3%; Coryza 943, 69%; Cough 780, 57.1%; 
Headache 601, 44.0%; Tiredness 565, 41.3%; General malaise 365, 26.7% (further 19 doc- 
umented) 


Demographics: median age 36.4y (IQR 27.0, 49.6y); 523, 38.3% male 


Exposure history: 233, 17% contact with confirmed case 


Test name: Panbio™ COVID-19 Ag Rapid Test (lot 41ADF011A) 
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Gremmels 2020(a) (Continued) 





Manufacturer: Abbott (Lake Country, IL, U.S.A) 

Antibody: NP 

Antigen target: Not stated 

Test method: Not stated 

Samples used: NP; obtained after NOP swab for RT-PCR; implies collected by HCW 


Transport media: Unclear; states transferred to 3 ml UTM after collection until further 
processing but also describes collected swabs transferred into dedicated sample collec- 
tion tubes containing a sampling buffer for Ag test 


Sample storage: Not stated; within 2 hours of collection 

Test operator: Two independent observers 

Definition of test positivity: Visual line within 15 mins; as per manufacturer 
Blinding reported: Yes; observers (blinded to each other and to the PCR results) 


Timing of samples: Cohort [1] (data on duration of symptoms reportedly missing for 201 
subjects; total reported here is 1138 but denominator for %s is 1166) 
day 1-3 pso 387, 33.2%; day 4-7 560, 48.0%; day >7 191, 16.4% 


Target condition and reference stan- Reference standard: RT-PCR; Seegene Allplex 
dard(s) positive result on amplification of any of the three SARS-CoV-2 genes 


Definition of non-COVID cases: As for cases; single negative result 
Genetic target(s): E-, N-, and RdRP-gene 

Samples used: NOP (paired) 

Timing of reference standard: NOP swab obtained first for RT-PCR 
Blinded to index test: Not stated 


Incorporated index test: No 


Flow and timing Time interval between index and reference tests: Paired 
All patients received same reference standard: Yes 


Missing data: 2 patients excluded (‘inappropriate application of NP swab and lab misla- 
belling'), disease status not reported. [Considered overall low risk of bias due to small 
numbers] 


Uninterpretable results: None reported 


Indeterminate results (index test): None; no bands were classified as unclear by the in- 
dependent observers 


Indeterminate results (reference standard): Patients 


Unit of analysis: 
Comparative 


Notes Funding: This study was investigator initiated. No external funding was received 
Publication status: Pre-print 


Source: medRxiv 
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Gremmels 2020(a) (Continued) 





Author COI: No COI statement reported 
Methodological quality 
Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of Yes 
patients enrolled? 


Was a case-control design avoided? Yes 

Did the study avoid inappropriate exclu- Yes 

sions? 

Did the study avoid inappropriate inclu- Yes 

sions? 

Could the selection of patients have in- Low risk 


troduced bias? 


Are there concerns that the included Low concern 
patients and setting do not match the 
review question? 


DOMAIN 2: Index Test (Antigen tests) 
Were the index test results interpreted Yes 
without knowledge of the results of the 


reference standard? 


If a threshold was used, was it pre-speci- Yes 
fied? 


Could the conduct or interpretation of Low risk 
the index test have introduced bias? 


Are there concerns that the index test, High 
its conduct, or interpretation differ 

from the review question? 

DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to cor- No 
rectly classify the target condition? 


Were the reference standard results inter- | Unclear 
preted without knowledge of the results 
of the index tests? 


Reference standard does notincorporate Yes 
result of index test? 
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Gremmels 2020(a) (continued) 





Could the reference standard, its con- High risk 

duct, or its interpretation have intro- 

duced bias? 

Are there concerns that the target con- High 

dition as defined by the reference stan- 

dard does not match the question? 

DOMAIN 4: Flow and Timing 

Was there an appropriate interval be- Yes 

tween index test and reference standard? 

Did all patients receive the same refer- Yes 

ence standard? 

Were all patients included in the analysis? No 

Did all participants receive a reference Yes 

standard? 

Were results presented per patient? Yes 

Could the patient flow have introduced Low risk 

bias? 

Gremmels 2020(b) 

Study characteristics 

Patient Sampling Report of two cohorts of patients presenting for COVID-19 testing. Gremmels 
2020(b) entry relates to: 
[2] community-dwelling mildly symptomatic subjects in a high endemic area 
(n=208) 
Gremmels 2020(a) entry reports data for second cohort in a medium endemic 
area 
Recruitment: Yes; all individuals invited to participate 
Prospective or retrospective: Prospective 

Patient characteristics and setting Setting: Community testing centre 
Location: [2] Horacio Oduber Hospital on Aruba 
Country: Netherlands 
Dates: [2] Sep 23 to Oct 9 
Symptoms and severity: Not stated; 'mildly symptomatic’, presume mixed as 
per Gremmels 2020a 
Demographics: Not stated 
Exposure history: Not stated 

Index tests Test name: Panbio™ COVID-19 Ag Rapid Test (lot 41ADF011A) 

Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 148 


Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 


Collaboration. 


2 Coch rane Trusted evidence. 
e f d decisi ; 
tg Library peterneatn. 


Cochrane Database of Systematic Reviews 





Gremmels 2020(b) (Continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Manufacturer: Abbott (Lake Country, IL, U.S.A) 
Antibody: NP 

Antigen target: Not stated 

Test method: Not stated 


Samples used: NP; obtained after NOP swab for RT-PCR; implies collected by 
HCW 


Transport media: No UTM used for Ag samples; collected swabs transferred into 
dedicated sample collection tubes containing a sampling buffer 


Sample storage: Not stated; within 2 hours of collection 

Test operator: Two independent observers 

Definition of test positivity: Visual line within 15 mins; as per manufacturer 
Blinding reported: Yes; observers (blinded to each other and to the PCR results) 


Timing of samples: Not stated; on presentation 


Reference standard: RT-PCR; Seegene Allplex 
positive result = amplification of any of the three SARS-CoV-2 genes 


Definition of non-COVID cases: As for cases; single negative result 
Genetic target(s): E-, N-, and RdRP-gene 

Samples used: NOP (paired) 

Timing of reference standard: NOP swab obtained first for RT-PCR 
Blinded to index test: Not stated 


Incorporated index test: No 


Time interval between index and reference tests: Paired 
All patients received same reference standard: Yes 
Missing data: None reported for Aruba site 
Uninterpretable results: None reported 


Indeterminate results (index test): None; no bands were classified as unclear by 
the independent observers 


Indeterminate results (reference standard): none 


Unit of analysis: patients 


Funding: This study was investigator initiated. No external funding was received 
Publication status: Pre-print 
Source: medRxiv 


Author COI: No COI statement reported 
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Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of patients Yes 
enrolled? 


Was a case-control design avoided? Yes 
Did the study avoid inappropriate exclusions? Yes 
Did the study avoid inappropriate inclusions? Yes 


Could the selection of patients have introduced Low risk 
bias? 


Are there concerns that the included patients Low concern 
and setting do not match the review question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test results interpreted without Yes 

knowledge of the results of the reference stan- 

dard? 

If a threshold was used, was it pre-specified? Yes 

Could the conduct or interpretation of the in- Low risk 


dex test have introduced bias? 


Are there concerns that the index test, its con- High 
duct, or interpretation differ from the review 
question? 


DOMAIN 2: Index Test (Rapid molecular tests) 
DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly clas- No 
sify the target condition? 


Were the reference standard results interpret- Unclear 
ed without knowledge of the results of the index 
tests? 


Reference standard does not incorporate result of Yes 
index test? 


Could the reference standard, its conduct, or High risk 
its interpretation have introduced bias? 


Are there concerns that the target condition High 
as defined by the reference standard does not 


match the question? 


DOMAIN 4: Flow and Timing 
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Gremmels 2020(b) (Continued) 


Was there an appropriate interval between index 
test and reference standard? 


Did all patients receive the same reference stan- 
dard? 


Were all patients included in the analysis? 
Did all participants receive a reference standard? 
Were results presented per patient? 


Could the patient flow have introduced bias? 


Gupta 2020 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Yes 


Yes 


Yes 
Yes 
Yes 


Low risk 


Single group study to estimate sensitivity and specificity: 

- symptomatic patients with suspected COVID-19 and asymptomatic contacts of 
laboratory-confirmed cases between 5 and 10 days of exposure, meeting Indian 
Council of Medical Research (ICMR) strategy for COVID-19 testing 


Recruitment: Consecutive 


Prospective or retrospective: Not stated; appears prospective 


Setting: Outpatient (tertiary care hospital) 

Location: All India Institute of Medical Sciences (AIIMS), New Delhi 

Country: India 

Dates: May 31 to July 24, 2020. 

Symptoms and severity: 204 (62%) symptomatic; 126 (38%) asymptomatic. 
median symptom duration: 1 day (range: 1-10). Symptoms included: fever (31.5%), 
cough (25.4%), fatigue/malaise (11.8%), headache (3.3%), runny nose (3.3%) 
Demographics: median age 34.1+12.6 yr; 231 (70%) male 


Exposure history: 127 asymptomatic were in contact with confirmed case 





Index tests Test name: Standard Q rapid antigen detection test 

Manufacturer: SD Biosensor, Inc., Gurugram 
Antibody: Not stated 
Antigen target: Not stated 
Test method: Not stated 
Samples used: NP; collection method detailed but personnel not described; pre- 
sume HCW. Sequence for specimen collection was random for both the samples (Ag 
and RT-PCR) 
Transport media: None 
Sample storage: None 
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Gupta 2020 (continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Test operator: Same person who obtained swab; HCW 
Definition of test positivity: Visual; test and control lines 
Blinding reported: Yes; conducted first 


Timing of samples: Symptomatic: 192 (95%) <=5 days pso (incl 57 cases) 


Reference standard: RT-PCR; commercial assay (BGI Genomics Co. Ltd., China). 
Psoitive defined as per manufacturer IFU 


Definition of non-COVID cases: As for cases; single negative 
Genetic target(s): ORF1 ab 
Samples used: nasal and throat swabs (NOP) in VTM 


Timing of reference standard: As for index test; states the sequence for specimen 
collection was random for both the samples 


Blinded to index test: Not stated 


Incorporated index test: No 


Time interval between index and reference tests: Simultaneous; paired swabs 
All patients received same reference standard: Yes 

Missing data: None reported, no participant flow diagram reported 
Uninterpretable results: None reported 

Indeterminate results (index test): None reported 

Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 


Funding: Study was financially supported by the Indian Council of Medical Research, 
New Delhi (for the Regional Virus Research and Diagnostic Laboratory at the All In- 
dia Institute of Medical Sciences, New Delhi). 


Publication status: Published 
Source: Indian J Med Res 


Author COI: Author report no COI present 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
Was a consecutive or random sample of pa- Yes 
tients enrolled? 
Was a case-control design avoided? Yes 
Did the study avoid inappropriate exclusions? Yes 
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Did the study avoid inappropriate inclusions? 


Could the selection of patients have intro- 
duced bias? 


Are there concerns that the included pa- 
tients and setting do not match the review 
question? 


DOMAIN 2: Index Test (Antigen tests) 

Were the index test results interpreted with- 
out knowledge of the results of the reference 
standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the 
index test have introduced bias? 


Are there concerns that the index test, its 
conduct, or interpretation differ from the 
review question? 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly 
classify the target condition? 


Were the reference standard results interpret- 
ed without knowledge of the results of the in- 


dex tests? 


Reference standard does not incorporate re- 
sult of index test? 


Could the reference standard, its conduct, 
or its interpretation have introduced bias? 


Are there concerns that the target condi- 
tion as defined by the reference standard 
does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between in- 
dex test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Did all participants receive a reference stan- 
dard? 


Yes 


Low risk 


Yes 


Yes 


Low risk 


No 


Unclear 


Yes 


High risk 


Yes 


Yes 


Unclear 


Yes 


Cochrane Database of Systematic Reviews 


Low concern 


Low concern 


High 
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Gupta 2020 (continued) 





Were results presented per patient? Yes 


Could the patient flow have introduced Unclear risk 
bias? 


Harrington 2020 


Study characteristics 


Patient Sampling Single-group study to estimate sensitivity and specificity: 
- symptomatic patients meeting diagnostic criteria for COVID-19 (n = 524) 


Recruitment: consecutive 
Prospective or retrospective: unclear; presume prospective 


Number of samples (samples with confirmed SARS-CoV-2): 524 (186) 


Patient characteristics and setting Setting: ED (n = 3) or urgent (immediate) care centres (n = 2) 


Location: not stated; author institutions Loyola University Medical Centre, Cedars-Si- 
nai Medical Centre 


Country: USA 

Dates: not reported 

Symptoms and severity: not stated 
Demographics: not stated 


Exposure history: not stated 


Index tests Test name: ID NOW COVID-19 assay (no product code provided) 
Manufacturer: Abbott 
Antigen target: not stated 
Antibody: N/A 
Test method: not stated; isothermal PCR 
Samples used: nasal swabs (provider collected) 
Transport media: none; direct testing after heat inactivation 


Sample storage: ED swabs transported in sterile transport containers (using cups or 
conical tubes) 


Test operator: on-site medical personnel (urgent care centres); laboratory personnel at 
each separate location (EDs) 

- 2 sites reportedly experienced users of ID NOW (one ED and one urgent care centre) 
and 3 sites received training) 


Definition of test positivity: as per manufacturer 
Blinding reported: yes (RT-PCR performed at separate central lab) 


Timing of samples: not stated; on presentation 
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Target condition and reference standard(s) Reference standard: RT-PCR (Abbott RealTime SARS-CoV-2 (ACOV) assay performed on 
the Abbott m2000 system (Abbott Molecular Inc. Des Plaines, IL); threshold not stated 


Definition of non-COVID cases: not specifically stated; presume yes as central lab used 
Genetic target(s): not stated 

Samples used: NP swabs 

Timing of reference standard: VTM (no detail) 


Blinded to index test: not stated, transferred to central clinical laboratory; samples 
heat inactivated for 30 min at 60 °C prior to testing 


Incorporated index test: no (paired collection with swabs for index test) 


Flow and timing Time interval between index and reference tests: simultaneous swab collection (differ- 
ent swabs for index and reference) 


All participants received same reference standard: yes 

Missing data: none reported, no participant flow diagram reported 
Uninterpretable results: none reported 

Indeterminate results (index test): none reported 


Indeterminate results (reference standard): 2 initial FPs had repeat sampling: 

- 1 retested on RT-PCR only and was positive (designated as TP) 

- Ll retested on RT-PCR and ID NOW and was negative on both (designated as FP based 
on original sampling) 


Unit of analysis: participants 
Comparative 


Notes Funding: study authors received "received no specific grant from any funding agency in 
the public, commercial, or not-for-profit sectors" 


Publication status: accepted manuscript 
Source: Journal of Clinical Microbiology 


Author COI: COI not mentioned 
Methodological quality 
Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of Yes 
patients enrolled? 





Was a case-control design avoided? Yes 
Did the study avoid inappropriate exclu- Yes 
sions? 
Did the study avoid inappropriate inclu- Yes 
sions? 
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Harrington 2020 (continued) 
Could the selection of patients have in- 
troduced bias? 


Are there concerns that the included pa- 
tients and setting do not match the re- 
view question? 


DOMAIN 2: Index Test (Antigen tests) 


Low risk 


DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test results interpreted 
without knowledge of the results of the ref- 
erence standard? 


If a threshold was used, was it pre-speci- 
fied? 


Could the conduct or interpretation of 
the index test have introduced bias? 


Are there concerns that the index test, 
its conduct, or interpretation differ from 
the review question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correct- 
ly classify the target condition? 


Were the reference standard results inter- 
preted without knowledge of the results of 
the index tests? 


Reference standard does not incorporate 
result of index test? 


Could the reference standard, its con- 
duct, or its interpretation have intro- 
duced bias? 

Are there concerns that the target con- 
dition as defined by the reference stan- 
dard does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between 
index test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Did all participants receive a reference 
standard? 


Yes 


Yes 


Low risk 


No 


Yes 


Yes 


High risk 


Yes 


Yes 


Unclear 


Yes 


Low concern 


Low concern 


High 
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Were results presented per patient? Yes 


Could the patient flow have introduced Unclear risk 
bias? 


Hogan 2020 


Study characteristics 


Patient Sampling Single-group design to estimate sensitivity and specificity 
- samples from adult patients from 1 hospital and paediatric and adult samples 
from surrounding hospitals 


Recruitment: unclear; equal numbers of positive and negative RT-PCR samples (sus- 
pect deliberate sampling by PCR result) 


Prospective or retrospective: not stated 


Number of samples (samples with confirmed SARS-CoV-2): 100 (50) 


Patient characteristics and setting Setting: hospital; not stated if inpatient or outpatient (samples selected from clini- 
cal virology laboratory) 


Location: Stanford Health Care (hospital), and surrounding hospitals (not named) 
Country: USA 

Dates: 7-13 April 2020 

Symptoms and severity: not stated 

Demographics: not stated 


Exposure history: not stated 


Index tests Test name: Accula SARS-CoV-2 POCT (no product code reported) 
Manufacturer: Mesa Biotech, Inc., San Diego, CA 
Antigen target: N gene 
Antibody: N/A 
Test method: rapid PCR 


Samples used: NP swabs in VTM (n = 37) or saline (n = 63, including 37 positive on 
RT-PCR) 


Transport media: not stated; 10 uL of VTM or saline was transferred to 60 uL of 
SARS-CoV-2 buffer within a biosafety cabinet (not covered by manufacturer IFU) 


Sample storage: not stated; testing appears to have been conducted soon after 
sample collection 


Test operator: not stated; presume laboratory staff 
Definition of test positivity: as per manufacturer 
Blinding reported: not stated 


Timing of samples: not stated 
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Hogan 2020 (Continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Reference standard: RT-PCR; in-house SHC assay (cites Hogan 2020 10.1016/ 
j.jcv.2020.104383:104383) 


Definition of non-COVID cases: single RT-PCR negative 
Genetic target(s): E gene 

Samples used: NP swabs, same as for index test 
Timing of reference standard: not stated 

Blinded to index test: not stated 


Incorporated index test: no 


Time interval between index and reference tests: not stated but implies that both 
tests undertaken in laboratory soon after sample collection 


All participants received same reference standard: yes 
Missing data: none reported 
Uninterpretable results: 3 invalid results were re-tested; 1 positive and 2 negative 


Indeterminate results (index test): 1 known RT-PCR-positive sample that showed a 
faint positive test line was re-tested and again showed the same faint test line (con- 
sidered positive) 


Indeterminate results (reference standard): none reported 


Unit of analysis: refers to participants 


Funding: study authors report no specific funding 
Publication status: preprint 
Source: medRxiv 


Author COI: authors declare no COI present 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
Was a consecutive or random sample of pa- Unclear 
tients enrolled? 
Was a case-control design avoided? Unclear 
Did the study avoid inappropriate exclusions? Unclear 
Did the study avoid inappropriate inclusions? | Unclear 
Could the selection of patients have intro- Unclear risk 
duced bias? 
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Hogan 2020 (continued) 


Are there concerns that the included pa- 
tients and setting do not match the review 
question? 


DOMAIN 2: Index Test (Antigen tests) 


DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test results interpreted with- 
out knowledge of the results of the reference 
standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the 
index test have introduced bias? 


Are there concerns that the index test, its 
conduct, or interpretation differ from the 
review question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly 
classify the target condition? 


Were the reference standard results interpret- 
ed without knowledge of the results of the in- 
dex tests? 


Reference standard does not incorporate re- 
sult of index test? 


Could the reference standard, its conduct, 
or its interpretation have introduced bias? 


Are there concerns that the target condi- 
tion as defined by the reference standard 
does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between in- 
dex test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Did all participants receive a reference stan- 
dard? 


Were results presented per patient? 


Could the patient flow have introduced 
bias? 


Unclear 


Yes 


Unclear risk 


No 


Unclear 


Yes 


High risk 


Yes 


Yes 


Unclear 


Yes 


Yes 


Unclear risk 


High 


High 


High 
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Hou 2020 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Index tests 


Target condition and reference standard(s) 


Single group study using remnant OP swabs submitted for SARS-CoV-2 testing at 
three medical centers (n = 285) 


Recruitment: Not stated 


Prospective or retrospective: Retrospective 


Setting: Mixed inpatient and outpatient 


Location: Three sites in Wuhan: Wuhan Tongji hospital (n=99), Wuhan Pulmonary 
hospital (n=96); Wuhan No. 1 hospital (n=90) 


Country: China 
Dates: Feb to Apr 2020 


Symptoms and severity: 178 (62.5%) inpatient; 107 (37.5%) outpatients. Site 2 
were all inpatients 


Demographics: 220 (77.2%) aged <65 years; 159 (55.8%) male 


Exposure history: No details; all Wuhan 


Test name: Xpert Xpress (no product code reported) 
Manufacturer: Cepheid Inc 

Target gene(s): E, N2 

Antigen target: N/A 

Test method: Automated RT-PCR 

Samples used: OP 

Transport media: Not stated; ‘aliquot made' 

Sample storage: stored at -80°C within 24 h of collection 
Test operator: Not stated 


Definition of test positivity: Not stated; presume as per manufacturer (company 
funded study) - no mention of presumptive positive results 


Blinding reported: Not stated 


Timing of samples: Not stated 


Reference standard: RT-PCR assays approved by Chinese National Medical Prod- 
ucts Administration (NMPA) for the detection of SARS-CoV-2 


Definition of non-COVID cases: As for cases; single negative RT-PCR 

Genetic target(s): Not stated 

Samples used: OP (same as for rapid test) 

Timing of reference standard: Not stated; conducted at time of sample collection 


Blinded to index test: Yes 
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Hou 2020 (continued) 


Flow and timing 


Comparative 


Notes 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of pa- 
tients enrolled? 


Was a case-control design avoided? 
Did the study avoid inappropriate exclusions? 
Did the study avoid inappropriate inclusions? 


Could the selection of patients have intro- 
duced bias? 


Are there concerns that the included pa- 
tients and setting do not match the review 


question? 


DOMAIN 2: Index Test (Antigen tests) 


DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test results interpreted without 
knowledge of the results of the reference stan- 


dard? 


Incorporated index test: No 


Time interval between index and reference tests: Simultaneous (same swab); time 
period of frozen storage was not reported 


All patients received same reference standard: Yes, although could be different RT- 
PCR assays at different sites 


Missing data: None reported, no participant flow diagram reported 
Uninterpretable results: None reported 

Indeterminate results (index test): None reported 

Indeterminate results (reference standard): None reported 


Unit of analysis: Patients; states 'samples from unique patients' 


Funding: funded in part by the National Mega Project on Major Infectious Disease 
Prevention (2017ZX10103005-007) and by the Cepheid Investigator-Initiated Study 
award (Cepheid-IIS-2020-005). 


Publication status: Accepted manuscript 
Source: J Clin Microbiol 


Author COI: YWT is an employee of Cepheid, the commercial manufacturer of the 
Xpert Xpress SARS-CoV-2 test. The other authors declare no competing interests. 


Authors' judgement Risk of bias Applicability concerns 


Unclear 


Yes 
Unclear 
Unclear 


Unclear risk 


High 


Unclear 
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Hou 2020 (continued) 





If a threshold was used, was it pre-specified? Unclear 


Could the conduct or interpretation of the Unclear risk 
index test have introduced bias? 


Are there concerns that the index test, its High 
conduct, or interpretation differ from the re- 
view question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly No 
classify the target condition? 


Were the reference standard results interpret- Yes 
ed without knowledge of the results of the in- 
dex tests? 


Reference standard does not incorporate result Yes 
of index test? 


Could the reference standard, its conduct, or High risk 
its interpretation have introduced bias? 


Are there concerns that the target condition High 
as defined by the reference standard does 
not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between in- Yes 
dex test and reference standard? 


Did all patients receive the same reference Yes 
standard? 
Were all patients included in the analysis? Unclear 
Did all participants receive a reference stan- Yes 
dard? 
Were results presented per patient? Yes 
Could the patient flow have introduced bias? Unclear risk 
Jin 2020 
Study characteristics 
Patient Sampling Laboratory-based study presenting data on a total of 8043 specimens for different RT- 


PCR tests (n=7251) and ID NOW (n=792). States that a significant proportion of speci- 
mens tested by ID NOW were pre-admission screening specimens for surgical patients 
but does not report percentage. 

Eligible data refer to 

[1] single group study to estimate sensitivity and specificity in paired dry swabs and 
NP or OP swabs in UTM (n=52) 
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Jin 2020 (continued) 


Patient characteristics and setting 


Index tests 


Target condition and reference standard(s) 


Flow and timing 


[Additional cases only set: [2] 124 RT-PCR positive NP/OP samples in UTM samples in- 
cluded 117 ‘retested with ID NOW' and 7 samples diluted in UTM from 4 positive spec- 
imens (the diluted samples cannot be distinguished from the set of 117 and data have 
been excluded from review) 


Recruitment: Unclear 


Prospective or retrospective: Retrospective 


Setting: Unclear; may be predominantly screening of surgical patients 


Location: Molecular & Genomic Pathology Laboratory, Thomas Jefferson University 
Hospital, Philadelphia 


Country: USA 

Dates: April 23 to 26, 2020 
Symptoms and severity: Not stated 
Demographics: Not stated 


Exposure history: Not stated 


Test name: ID NOW (product code not reported) 
Manufacturer: Abbott Laboratories 

Target gene(s): RdRp 

Antigen target: n/a 

Test method: Isothermal PCR 

Samples used: 'dry swabs' as per manufacturer EUA protocol 
Transport media: None 

Sample storage: No storage reported (appears to be immediate testing) 
Test operator: Not stated; laboratory staff presumed 
Definition of test positivity: As per manufacturer 

Blinding reported: Not stated 'tested in parallel’ 


Timing of samples: Not stated 


Reference standard: RT-PCR; cobas SARS-CoV-2 Test (Roche Molecular Systems, Inc., 
Pleasanton, CA) using a cobas 6800 analyzer (Roche Molecular Systems, Inc). Either 
target present considered positive 


Definition of non-COVID cases: As above; single PCR negative required 
Genetic target(s): ORF1/a, E gene 


Samples used: Not specifically described for subset of paired samples, but for full co- 
hort NP and OP swabs in VTM used (400 uL) 


Timing of reference standard: Not stated 
Blinded to index test: Not stated; tested in parallel 


Incorporated index test: No 


Time interval between index and reference tests: Simultaneous (paired swabs) 
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Jin 2020 (continued) 


Comparative 


Notes 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of pa- 
tients enrolled? 


Was a case-control design avoided? 


Did the study avoid inappropriate exclu- 
sions? 


Did the study avoid inappropriate inclu- 
sions? 


Could the selection of patients have intro- 
duced bias? 


Are there concerns that the included pa- 
tients and setting do not match the re- 


view question? 


DOMAIN 2: Index Test (Antigen tests) 


DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test results interpreted with- 
out knowledge of the results of the refer- 
ence standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the 
index test have introduced bias? 


All patients received same reference standard: Yes 

Missing data: None reported 

Uninterpretable results: None reported, no participant flow diagram reported 
Indeterminate results (index test): None reported 

Indeterminate results (reference standard): None reported 


Unit of analysis: Not stated; described as 'paired patient specimens' 


Funding: No funding statement reported 
Publication status: Published 
Source: Arch Path Lab Med 


Author COI: No COI statement reported 


Authors' judgement Risk of bias Applicability concerns 
Unclear 
Yes 
Unclear 
Unclear 
Unclear risk 
Unclear 


Unclear 


Yes 


Unclear risk 
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Jin 2020 (continued) 





Are there concerns that the index test, its Unclear 
conduct, or interpretation differ from the 
review question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly No 
classify the target condition? 


Were the reference standard results inter- Unclear 
preted without knowledge of the results of 
the index tests? 


Reference standard does not incorporate re- Yes 
sult of index test? 


Could the reference standard, its conduct, High risk 
or its interpretation have introduced 
bias? 


Are there concerns that the target condi- High 
tion as defined by the reference standard 
does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between Yes 
index test and reference standard? 


Did all patients receive the same reference Yes 
standard? 
Were all patients included in the analysis? Unclear 


Did all participants receive areference stan- Yes 





dard? 
Were results presented per patient? Unclear 
Could the patient flow have introduced Unclear risk 
bias? 
Jokela 2020 
Study characteristics 
Patient Sampling Two group study to estimate sensitivity and specificity including NP or OP swab 
samples sent to university laboratory: 
[1] for SARS-CoV-2 testing (n=97), 
[2] pre-pandemic samples sent for testing due to suspicion of other respiratory 
virus infection (n=10) 
Recruitment: Not stated 
Prospective or retrospective: Not stated; presume retrospective 
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Jokela 2020 (continued) 


Patient characteristics and setting 


Index tests 


Target condition and reference standard(s) 


Flow and timing 


[Also reports results for third cohort of samples from participants attending ter- 
tiary care EDs (n=362), however index test is ineligible for this review (Novodiag))] 


Setting: Not reported 

Location: Helsinki University Hospital Laboratory (HUSLAB), Helsinki 
Country: Finland. 

Dates: Mar to May 2020 

Symptoms and severity: Not stated 

Demographics: Not stated 


Exposure history: Not stated 


Test name: Xpert Xpress (no product code reported) 
Manufacturer: Cepheid Inc 

Target gene(s): E, N2 

Antigen target: n/a 

Test method: Automated RT-PCR 

Samples used: NP or OP; no details on collection 
Transport media: Not stated 

Sample storage: Not stated 

Test operator: Not stated 


Definition of test positivity: Not stated; presume as per manufacturer - no men- 
tion of presumptive positive results 


Blinding reported: Not stated 


Timing of samples: Not stated 


Reference standard: RT-PCR, one of three assays including 1) in-house LDT, 2) 
cobas SARS-CoV-2 test kit (Roche), or 3) Amplidiag COVID-19 test on the Amplidi- 
ag Easy platform (Mobidiag) 


Definition of non-COVID cases: As above for COVID-19 suspects (single PCR neg- 
ative); for pre-pandemic either Allplex Respiratory Panel 1/2/3 (Seegene, Seoul, 
Republic of Korea) and two by xTAG RVP Fast (Luminex Diagnostics, Toronto, 
Canada). 


Genetic target(s): 1) N gene, 2) orflab and E, 3) orflab and N 
Samples used: NP or OP, as for index 

Timing of reference standard: Not stated 

Blinded to index test: Not stated 


Incorporated index test: No 


Time interval between index and reference tests: Simultaneous (same samples) 
All patients received same reference standard: Yes (different assays) 


Missing data: 107 samples tested with Novodiag but only 90 for Xpert 
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Jokela 2020 (continued) 


Comparative 


Notes 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of patients 
enrolled? 


Was a case-control design avoided? 
Did the study avoid inappropriate exclusions? 
Did the study avoid inappropriate inclusions? 


Could the selection of patients have intro- 
duced bias? 


Are there concerns that the included patients 
and setting do not match the review ques- 
tion? 

DOMAIN 2: Index Test (Antigen tests) 

DOMAIN 2: Index Test (Rapid molecular tests) 
Were the index test results interpreted without 
knowledge of the results of the reference stan- 
dard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the in- 
dex test have introduced bias? 


Are there concerns that the index test, its con- 
duct, or interpretation differ from the review 


question? 


DOMAIN 3: Reference Standard 


Uninterpretable results: None reported 
Indeterminate results (index test): None reported 
Indeterminate results (reference standard): None reported 


Unit of analysis: Not reported 


Funding: No funding statement reported 
Publication status: Preprint 
Source: medRxiv 


Author COI: No COI statement reported 


Authors' judgement Risk of bias Applicability concerns 


Unclear 


Yes 
Unclear 
Unclear 


Unclear risk 


Unclear 


Unclear 


Unclear 


Unclear risk 


Unclear 
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Jokela 2020 (continued) 


Is the reference standards likely to correctly No 
classify the target condition? 


Were the reference standard results interpret- Unclear 
ed without knowledge of the results of the index 


tests? 


Reference standard does not incorporate result Yes 


of index test? 


Could the reference standard, its conduct, or High risk 
its interpretation have introduced bias? 


Are there concerns that the target condition High 
as defined by the reference standard does not 


match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between index Yes 


test and reference standard? 


Did all patients receive the same reference stan- Yes 


dard? 


Were all patients included in the analysis? No 


Did all participants receive a reference stan- Yes 


dard? 


Were results presented per patient? Unclear 


Could the patient flow have introduced bias? High risk 


Kruger 2020(a) 


Study characteristics 


Patient Sampling 


Patient characteristics 
and setting 


Single group study to estimate sensitivity and specificity of three assays (each tested on a separate co- 
hort of individuals, and extracted as three entries Kruger 2020(a), Kruger 2020(b), Kruger 2020(c). 
Participants at risk for SARS-CoV-2 infection based on exposure to a confirmed case, suggestive symp- 
toms, or travel to a high risk area, presenting at one of three sites: 

(1) drive-in testing station (n=1213) 

(2) a clinical ambulatory testing facility (n=1308) 

(3) secondary care facility (n=53) 


This entry (Kruger 2020(a)) relates to the 727 participants tested with assay (a) from Shenzhen Bioeasy 
Biotechnology; it is unclear whether some particpants may have receieved more than one assay 

*This study was also reported as three independent FIND evaluations; author contact advised including 
data from the Kruger et al pre-print 


Recruitment: Not stated; recorded as consecutive, as per FIND evaluation protocol 


Prospective or retrospective: Prospective 


Setting: Mixed; (1), (2) Community (drive-in or clinical ambulatory testing); (3) secondary care 
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Kruger 2020(a) (Continued) 


Index tests 


Target condition and ref- 
erence standard(s) 


Location: Three sites: (1) Heidelberg, Germany; (2) Berlin, Germany and (3) Liverpool University Hospital 
Foundation Trust, Liverpool 


Country: (1), (2) Germany, (3) UK 

Dates: April 17th and August 25th, 2020; dates varied by assay and site 
Whole sample: 

Symptomatic on testing day (n=1901/2355, 80.7%) 

N with prior negative test result (n=236/1928, 12.2%) 

Mean age (SD) (n=2405: 40.4y (14.3)) 

Male (%) (n=1115/2361, 47.2%) 


Participants undergoing assay (a) (denominator back-calculated from n and %) 
Symptomatic on testing day: 564/694, 81.2% 


N with prior negative test result: 73/624, 11.7% 
Mean age (SD): 42.7y (14.9y) 


Male (%): 47.2% 


Study reports data for three Ag assays, each tested on a separate cohort of individuals. This entry 
(Kruger 2020(a)) relates to assay [A]. See Kruger 2020(b) and Kruger 2020(c) for assays (b) and (c) 


Test name: Bioeasy 2019-nCoV Ag Fluorescence Rapid Test Kit (Time-Resolved Fluorescence) 
Manufacturer: Shenzhen Bioeasy Biotechnology Co. Ltd., Guangdong Province, China 
Antibody: Not stated 

Antigen target: Not stated 

Test method: FIA 


Samples used: Drive-in centre: NP or OP; Other centres: combined NOP (OP conducted first) 
RT-PCR swab obtained first, then same technique repeated for Ag test. 


Transport media: None; used manufacturer supplied buffer solution as per IFU (for the Bioeasy assay, 
"the developer requested for pipettes to be used to transfer adequate quantities of liquid; in the IFU no 
pipette is needed and a nozzle is provided"). 


Sample storage: Drive-in centre and ambulatory testing: tested on site (presume short time frame) 
Secondary care: transported on ice to a category 3 facility for testing 
RT-PCR swab obtained first, then same technique repeated for Ag test. 


Test operator: Drive-in and ambulatory clinic: POC evaluation 
Secondary care: laboratory staff 


Definition of test positivity: as per Analyzer 

Invalid results were repeated once using the remaining buffer according to the respective IFUs. 
Readouts were done within the recommended time for each Ag-RDT (10 minutes for Bioeasy, 15 minutes 
for Coris and 15 to 30 minutes for SD Biosensor). 


Blinding reported: Yes; "Staff performing the Ag-RDTs were blinded to results of RT-PCR tests and vice 
versa" 


Timing of samples: Overall: mean 5 days pso (SD 9.6); for this assay 7.0 days (SD 12.2); 


Reference standard: RT-PCR; varied by site 
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Kruger 2020(a) (Continued) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Item 


Drive-in samples (Heidelberg): TibMolbiol (Berlin, Germany); the Allplex SARS-CoV-2 Assay from Seegene 
(Seoul, South Korea); or the Abbott (Illinois, US) RealTime 2019-nCoV assay 

Ambulatory testing (Berlin): Roche Cobas SARS CoV-2 assay (Pleasanton, CA United States) on the 
Cobas® 6800 or 8800 system; SARS CoV-2 assay from TibMolbiol (Berlin, Germany) 

Secondary care (UK): Genesig® Real-Time Coronavirus COVID-19 PCR assay (Genesig, UK) 

Samples that showed a signal above the threshold in the relevant RT-PCR target regions for each assay 
were considered to be positive 


Definition of non-COVID cases: As per cases; single negative result 
Genetic target(s): Not stated 


Samples used: Paired swabs; as per index test (RT-PCR swab obtained first,) 
Drive-in centre: NP or OP 
Other centres: combined NOP (OP conducted first) 


Timing of reference standard: As per index test 


Blinded to index test: Yes; "Staff performing the Ag-RDTs were blinded to results of RT-PCR tests and vice 
versa" 


Incorporated index test: No 


Time interval between index and reference tests: Paired; simultaneous 
All patients received same reference standard: Yes (different assays) 


Missing data: 154 excluded following enrolment [116 2nd swab refused, 3 nose bleed after 1st swab, 3 in- 
sufficient time for both swabs, 31 other reasons, 1 no reason available] 


Uninterpretable results: 2 invalid (PCR negative); PCR: 3 excluded as invalid (n=2) or not available (n=1) 
Indeterminate results (index test): None reported; 
Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 


Study reports an ease of use assessment; for this assay: 


¢ ahigh number of test execution steps (including precision pipetting) ... challenges when performing 
multiple tests at the same time possibly hindering the test’s wide-spread us 


Funding: Study was supported by FIND, Heidelberg University Hospital and Charité - University Hospital 
internal funds. Pfizer funded the clinical team in Liverpool, UK. 


Publication status: Pre-print 
Source: medRxiv 


Author COI: No COI statement reported; "external funders of the study had no role in study design, data 
collection, or data analysis" 


Authors' judgement Risk of bias Applicability concerns 


DOMAIN 1: Patient Selection 
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Kruger 2020(a) (Continued) 


Was aconsecutiveorran- Yes 
dom sample of patients 
enrolled? 


Was a case-control de- Yes 
sign avoided? 


Did the study avoidinap- Yes 
propriate exclusions? 


Did the study avoidinap- Yes 
propriate inclusions? 


Could the selection of Low risk 
patients have intro- 
duced bias? 


Are there concerns 
that the included pa- 
tients and setting do 
not match the review 
question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test re- Yes 
sults interpreted without 
knowledge of the results 

of the reference stan- 

dard? 


If a threshold was used, Yes 
was it pre-specified? 


Could the conduct or Low risk 
interpretation of the 

index test have intro- 

duced bias? 


Are there concerns that 
the index test, its con- 
duct, or interpretation 
differ from the review 
question? 


DOMAIN 2: Index Test (Rapid molecular tests) 
DOMAIN 3: Reference Standard 


Is the reference stan- No 
dards likely to correctly 
classify the target condi- 

tion? 


Were the reference stan- = Yes 
dard results interpreted 
without knowledge of 


Low concern 


Low concern 
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Kruger 2020(a) (Continued) 
the results of the index 
tests? 


Reference standard does 
not incorporate result of 
index test? 


Could the reference 
standard, its conduct, 
or its interpretation 
have introduced bias? 


Are there concerns that 
the target condition as 
defined by the refer- 
ence standard does not 
match the question? 


Yes 


High risk 


High 


DOMAIN 4: Flow and Timing 


Was there an appropriate 
interval between index 
test and reference stan- 
dard? 


Did all patients receive 
the same reference stan- 
dard? 


Were all patients includ- 
ed in the analysis? 


Did all participants re- 
ceive a reference stan- 
dard? 


Were results presented 
per patient? 


Could the patient flow 
have introduced bias? 


Kruger 2020(b) 


Study characteristics 


Patient Sampling 


Yes 


Yes 


No 


Yes 


Yes 


High risk 


Single group study to estimate sensitivity and specificity of three assays (each tested on a separate co- 
hort of individuals, and extracted as three entries Kruger 2020(a), Kruger 2020(b), Kruger 2020(c). 
Participants at risk for SARS-CoV-2 infection based on exposure to a confirmed case, suggestive symp- 
toms, or travel to a high risk area, presenting at one of three sites: 

(1) drive-in testing station (n=1213) 

(2) aclinical ambulatory testing facility (n=1308) 

(3) secondary care facility (n=53) 


This entry (Kruger 2020(c)) relates to the 425 participants tested with assay (b) from Coris Bioconcept; it 
is unclear whether some particpants may have receieved more than one assay 
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Kruger 2020(b) (continued) 


Patient characteristics and 
setting 


Index tests 


*This study was also reported as three independent FIND evaluations; author contact advised including 
data from the Kruger et al pre-print 


Recruitment: Not stated; recorded as consecutive, as per FIND evaluation protocol 


Prospective or retrospective: Prospective 


Setting: Mixed; (1), (2) Community (drive-in or clinical ambulatory testing); (3) secondary care 


Location: Three sites: (1) Heidelberg, Germany; (2) Berlin, Germany and (3) Liverpool University Hospi- 
tal Foundation Trust, Liverpool 


Country: (1), (2) Germany, (3) UK 

Dates: April 17th and August 25th, 2020; dates varied by assay and site 
Whole sample: 

Symptomatic on testing day (n=1901/2355, 80.7%) 

N with prior negative test result (nN=236/1928, 12.2%) 

Mean age (SD) (n=2405: 40.4y (14.3)) 

Male (%) (n=1115/2361, 47.2%) 


Participants undergoing assay (b) (denominator back-calculated from n and %) 
Symptomatic on testing day: 283/411, 68.9% 


N with prior negative test result: 38/301, 12.6% 
Mean age (SD): 44.9y (15.4y) 


Male (%): 39.7% 


Study reports data for three Ag assays, each tested on a separate cohort of individuals. See Kruger 
2020(a) and Kruger 2020(c) for details of the other assays 


Test name: COVID-19 Ag Respi-Strip 


Manufacturer: Coris Bioconcept, Gembloux, Belgium 
Antibody: Not stated 


Antigen target: Not stated 
Test method: CGIA 


Samples used: Drive-in centre: NP or OP 
Other centres: combined NOP (OP conducted first) 
RT-PCR swab obtained first, then same technique repeated for Ag test. 


Transport media: None; used manufacturer supplied buffer solution as per IFU 


Sample storage: Drive-in centre and ambulatory testing: tested on site (presume short time frame) 
Secondary care: transported on ice to a category 3 facility for testing 
RT-PCR swab obtained first, then same technique repeated for Ag test. 


Test operator: Drive-in and ambulatory clinic: POC evaluation 
Secondary care: laboratory staff 


Definition of test positivity: Visual appearance were interpreted by two operators, each blinded to the 
result of the other. In case of discrepant results, both operators re-read the result and agreed on a final 
result. 

Invalid results were repeated once using the remaining buffer according to the respective IFUs. 
Readouts were done within the recommended time for each Ag-RDT (15 minutes for Coris). 
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Kruger 2020(b) (continued) 


Target condition and ref- 
erence standard(s) 


Flow and timing 


Comparative 


Notes 


Blinding reported: Yes; "Staff performing the Ag-RDTs were blinded to results of RT-PCR tests and vice 
versa" 


Timing of samples: Overall: mean 5 days pso (SD 9.6); this assay 6.2 days (SD 14.0) 


Reference standard: RT-PCR; varied by site 

Drive-in samples (Heidelberg): TibMolbiol (Berlin, Germany); the Allplex SARS-CoV-2 Assay from See- 
gene (Seoul, South Korea); or the Abbott (Illinois, US) RealTime 2019-nCoV assay 

Ambulatory testing (Berlin): Roche Cobas SARS CoV-2 assay (Pleasanton, CA United States) on the 
Cobas® 6800 or 8800 system; SARS CoV-2 assay from TibMolbiol (Berlin, Germany) 

Secondary care (UK): Genesig® Real-Time Coronavirus COVID-19 PCR assay (Genesig, UK) 

Samples that showed a signal above the threshold in the relevant RT-PCR target regions for each assay 
were considered to be positive 


Definition of non-COVID cases: As per cases; single negative result 
Genetic target(s): Not stated 


Samples used: Paired swabs; as per index test (RT-PCR swab obtained first,) 
Drive-in centre: NP or OP 
Other centres: combined NOP (OP conducted first) 


Timing of reference standard: As per index test 


Blinded to index test: Yes; "Staff performing the Ag-RDTs were blinded to results of RT-PCR tests and 
vice versa" 


Incorporated index test: No 


Time interval between index and reference tests: Paired; simultaneous 
All patients received same reference standard: Yes (different assays) 


Missing data: 154 excluded following enrolment [116 2nd swab refused, 3 nose bleed after 1st swab, 3 
insufficient time for both swabs, 31 other reasons, 1 no reason available] 


Uninterpretable results: 8 invalid (PCR negative) 

PCR: 3 excluded as invalid (n=2) or not available (n=1) 
Indeterminate results (index test): None reported; 
Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 


Study reports an ease of use assessment; for this assay: 


* challenges due to inconsistent test result interpretation (often only very faint lines visible) and defi- 
ciencies in both the test kit quality and design 


Funding: Study was supported by FIND, Heidelberg University Hospital and Charité - University Hospi- 
tal internal funds. Pfizer funded the clinical team in Liverpool, UK. 


Publication status: Pre-print 
Source: medRxiv 


Author COI: No COI statement reported; "external funders of the study had no role in study design, data 
collection, or data analysis" 
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Kruger 2020(b) (continued) 





Methodological quality 
Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 


Was a consecutive or ran- Yes 
dom sample of patients 
enrolled? 


Was acase-controldesign Yes 
avoided? 


Did the study avoid inap- Yes 
propriate exclusions? 


Did the study avoid inap- Yes 
propriate inclusions? 


Could the selection of pa- Low risk 
tients have introduced 
bias? 


Are there concerns that Low concern 
the included patients 

and setting do not match 

the review question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test re- Yes 
sults interpreted without 
knowledge of the results 

of the reference standard? 


If athreshold was used, Yes 
was it pre-specified? 


Could the conduct or in- Low risk 
terpretation of the in- 

dex test have introduced 

bias? 


Are there concerns that Low concern 
the index test, its con- 

duct, or interpretation 

differ from the review 

question? 


DOMAIN 2: Index Test (Rapid molecular tests) 
DOMAIN 3: Reference Standard 
Is the reference standards No 


likely to correctly classify 
the target condition? 
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Kruger 2020(b) (continued) 





Were the reference stan- Yes 
dard results interpreted 

without knowledge of the 

results of the index tests? 


Reference standard does Yes 
not incorporate result of 
index test? 


Could the reference stan- High risk 
dard, its conduct, or its 

interpretation have in- 

troduced bias? 


Are there concerns that High 
the target condition as 

defined by the reference 

standard does not match 

the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate Yes 
interval between index 

test and reference stan- 

dard? 


Did all patients receive the Yes 
same reference standard? 


Were all patientsincluded No 
in the analysis? 


Did all participants receive Yes 
a reference standard? 


Were results presented per Yes 
patient? 


Could the patient flow High risk 
have introduced bias? 


Kruger 2020(c) 


Study characteristics 


Patient Sampling Single group study to estimate sensitivity and specificity of three assays (each tested on a separate cohort 
of individuals, and extracted as three entries Kruger 2020(a), Kruger 2020(b), Kruger 2020(c). 
Participants at risk for SARS-CoV-2 infection based on exposure to a confirmed case, suggestive symp- 
toms, or travel to a high risk area, presenting at one of three sites: 
(1) drive-in testing station (n=1213) 
(2) aclinical ambulatory testing facility (nN=1308) 
(3) secondary care facility (n=53) 


This entry (Kruger 2020(c)) relates to the 1263 participants tested with assay (c) from SD Biosensor; it is 
unclear whether some particpants may have receieved more than one assay 
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Kruger 2020(c) (Continued) 


Patient characteristics 
and setting 


*This study was also reported as three independent FIND evaluations; author contact advised including 
data from the Kruger et al pre-print 


Recruitment: Not stated; recorded as consecutive, as per FIND evaluation protocol 


Prospective or retrospective: Prospective 


Setting: Mixed; (1), (2) Community (drive-in or clinical ambulatory testing); (3) secondary care 


Location: Three sites: (1) Heidelberg, Germany; (2) Berlin, Germany and (3) Liverpool University Hospital 
Foundation Trust, Liverpool 


Country: (1), (2) Germany, (3) UK 

Dates: April 17th and August 25th, 2020; dates varied by assay and site 
Whole sample: 

Symptomatic on testing day (n=1901/2355, 80.7%) 

N with prior negative test result (nN=236/1928, 12.2%) 

Mean age (SD) (n=2405: 40.4y (14.3)) 

Male (%) (n=1115/2361, 47.2%) 


Participants undergoing assay (b) (denominator back-calculated from n and %) 
Symptomatic on testing day: 1054/1249, 84.4% 


N with prior negative test result: 125/1000, 12.5% 
Mean age (SD): 37.6 (12.7) 
Male (%): 49.8% 


Exposure history: Not stated 





Index tests Study reports data for three Ag assays, each tested on a separate cohort of individuals. See Kruger 2020(a) 

and Kruger 2020(b) for details of the other assays 
Test name:STANDARD Q COVID-19 Ag Test 
Manufacturer: SD Biosensor, Inc. Gyeonggi-do, Korea 
Antibody: Not stated 
Antigen target: Not stated 
Test method: CGIA 
Samples used: Drive-in centre: NP or OP 
Other centres: combined NOP (OP conducted first) 
RT-PCR swab obtained first, then same technique repeated for Ag test. 
Transport media: None; used manufacturer supplied buffer solution as per IFU 
Sample storage: Drive-in centre and ambulatory testing: tested on site (presume short time frame) 
Secondary care: transported on ice to a category 3 facility for testing 
RT-PCR swab obtained first, then same technique repeated for Ag test. 
Test operator: Drive-in and ambulatory clinic: POC evaluation 
Secondary care: laboratory staff 
Definition of test positivity: Visual appearance were interpreted by two operators, each blinded to the re- 
sult of the other. In case of discrepant results, both operators re-read the result and agreed on a final re- 
sult. 
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Kruger 2020(c) (Continued) 


Target condition and 
reference standard(s) 


Flow and timing 


Comparative 


Invalid results were repeated once using the remaining buffer according to the respective IFUs. 
Readouts were done within the recommended time for each Ag-RDT (10 minutes for Bioeasy, 15 minutes 
for Coris and 15 to 30 minutes for SD Biosensor). 


Blinding reported: Yes; "Staff performing the Ag-RDTs were blinded to results of RT-PCR tests and vice ver- 
sa" 


Timing of samples: Overall: mean 5 days pso (SD 9.6); this assay 3.7 days (SD 5.6) 


Reference standard: RT-PCR; varied by site 

Drive-in samples (Heidelberg): TibMolbiol (Berlin, Germany); the Allplex SARS-CoV-2 Assay from Seegene 
(Seoul, South Korea); or the Abbott (Illinois, US) RealTime 2019-nCoV assay 

Ambulatory testing (Berlin): Roche Cobas SARS CoV-2 assay (Pleasanton, CA United States) on the Cobas® 
6800 or 8800 system; SARS CoV-2 assay from TibMolbiol (Berlin, Germany) 

Secondary care (UK): Genesig® Real-Time Coronavirus COVID-19 PCR assay (Genesig, UK) 

Samples that showed a signal above the threshold in the relevant RT-PCR target regions for each assay 
were considered to be positive 


Definition of non-COVID cases: As per cases; single negative result 
Genetic target(s): Not stated 


Samples used: Paired swabs; as per index test (RT-PCR swab obtained first,) 
Drive-in centre: NP or OP 
Other centres: combined NOP (OP conducted first) 


Timing of reference standard: As per index test 


Blinded to index test: Yes; "Staff performing the Ag-RDTs were blinded to results of RT-PCR tests and vice 
versa" 


Incorporated index test: No 


Time interval between index and reference tests: Paired; simultaneous 
All patients received same reference standard: Yes (different assays) 


Missing data: 154 excluded following enrolment [116 2nd swab refused, 3 nose bleed after 1st swab, 3 in- 
sufficient time for both swabs, 31 other reasons, 1 no reason available] 


Uninterpretable results: 2 invalid (PCR negative); [B] 8 invalid (PCR negative); [C] 0 invalid reported 
PCR: 3 excluded as invalid (n=2) or not available (n=1) 


Indeterminate results (index test): None reported; 


Ease of use assessment reported: 

[A] a high number of test execution steps (including precision pipetting) ... challenges when performing 
multiple tests at the same time possibly hindering the test’s wide-spread use 

[B] challenges due to inconsistent test result interpretation (often only very faint lines visible) and defi- 
ciencies in both the test kit quality and design 

[C] no dissatisfactory scores identified 


Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 





Notes Study reports an ease of use assessment; for this assay: 
« no dissatisfactory scores identified 
Funding: Study was supported by FIND, Heidelberg University Hospital and Charité - University Hospital 
internal funds. Pfizer funded the clinical team in Liverpool, UK. 
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Kruger 2020(c) (Continued) 


Methodological quality 


Item 


Publication status: Pre-print 


Source: medRxiv 


Author COI: No COI statement reported; "external funders of the study had no role in study design, data 


collection, or data analysis" 


Authors' judgement Risk of bias 


DOMAIN 1: Patient Selection 


Was a consecutive or 
random sample of pa- 
tients enrolled? 


Was a case-control de- 
sign avoided? 


Did the study avoid in- 
appropriate exclusions? 


Did the study avoid in- 
appropriate inclusions? 


Could the selection of 
patients have intro- 
duced bias? 


Are there concerns 
that the included pa- 
tients and setting do 
not match the review 
question? 


Yes 


Yes 


Yes 


Yes 


Low risk 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test re- 
sults interpreted with- 
out knowledge of the 
results of the reference 
standard? 


If athreshold was used, 
was it pre-specified? 


Could the conduct or 
interpretation of the 

index test have intro- 
duced bias? 


Are there concerns 
that the index test, its 
conduct, or interpre- 
tation differ from the 
review question? 


Yes 


Yes 


Low risk 


DOMAIN 2: Index Test (Rapid molecular tests) 


Applicability concerns 


Low concern 


Low concern 
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Kruger 2020(c) (Continued) 


DOMAIN 3: Reference Standard 


Is the reference stan- 
dards likely to correctly 
classify the target con- 
dition? 


Were the reference 
standard results inter- 
preted without knowl- 
edge of the results of 
the index tests? 


Reference standard 
does not incorporate 
result of index test? 


Could the reference 
standard, its conduct, 
or its interpretation 
have introduced bias? 


Are there concerns 
that the target condi- 
tion as defined by the 
reference standard 
does not match the 
question? 


No 


Yes 


Yes 


DOMAIN 4: Flow and Timing 


Was there an appropri- 
ate interval between in- 
dex test and reference 
standard? 


Did all patients receive 
the same reference 
standard? 


Were all patients in- 
cluded in the analysis? 


Did all participants re- 
ceive a reference stan- 
dard? 


Were results presented 
per patient? 


Could the patient flow 
have introduced bias? 


Lambert-Niclot 2020 


Study characteristics 


Yes 


Yes 


Yes 


Yes 


Yes 


High risk 


Low risk 


High 
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Lambert-Niclot 2020 (continued) 


Patient Sampling 


Patient characteristics and setting 


Index tests 


Target condition and reference standard(s) 


Single-group study to estimate sensitivity and specificity: 
- samples submitted for RT-PCR testing (n = 138) 


Recruitment: not stated 
Prospective or retrospective: unclear; testing conducted prospectively 


Number of samples (samples with confirmed SARS-CoV-2): 138 (94) 


Setting: not stated 


Location: samples collected from virology laboratories of 3 university hospital 
groups from Assistance-Publique-H6pitaux de Paris (APHP), (Saint-Antoine-Tenon- 
Trousseau, Saint-Louis-Lariboisiére and Kremlin Bicétre-Paul Brousse) 


Country: France 

Dates: 1-15 April 2020 

Symptoms and severity: not stated 
Demographics: not stated 


Exposure history: not stated 


Test name: COVID-19 Ag Respi-Strip CORIS (no product code) 
Manufacturer: BioConcept, Gembloux, Belgium 

Antigen target: SARS-CoV-2 NP 

Antibody: monoclonal antibodies 

Test method: CGIA 

Samples used: NP swabs in VTM (collection process not described) 


Transport media: either of: COPAN UTM 3 mL, Virocult 1 mL, Eswab Amies 1 mL, 
4MRT 3 mL, 0.9% NaCl buffer and cobas ROCHE 


Sample storage: no cooling or freezing step used 

Test operator: not stated; presume laboratory staff 
Definition of test positivity: not stated; as per manufacturer 
Blinding reported: not stated 


Timing of samples: not stated; presume on presentation 


Reference standard: RT-PCR (different kits used including RealStar Altona®, Anato- 
lia®, cobas 6800 Roche®, Allplex™ 2019-nCoV Assay Seegene®) 


Definition of non-COVID cases: single negative PCR 
Genetic target(s): E gene 
Samples used: NP swabs (same as for index) 


Timing of reference standard: within a few hours after collection; time post onset of 
symptoms not reported 


Blinded to index test: unclear 


Incorporated index test: no 
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Lambert-Niclot 2020 (continued) 


Flow and timing 


Comparative 


Notes 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of pa- 
tients enrolled? 


Was a case-control design avoided? 
Did the study avoid inappropriate exclusions? 
Did the study avoid inappropriate inclusions? 


Could the selection of patients have intro- 
duced bias? 


Are there concerns that the included pa- 
tients and setting do not match the review 
question? 

DOMAIN 2: Index Test (Antigen tests) 

Were the index test results interpreted with- 
out knowledge of the results of the reference 
standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the 
index test have introduced bias? 


Time interval between index and reference tests: same sample, both tests conduct- 
ed within a few hours 


All participants received same reference standard: yes (different kits) 
Missing data: none reported 


Uninterpretable results: 4 samples collected in cobas VTM gave invalid results and 
all samples in cobas medium were excluded 


Indeterminate results (index test): control lines reported as "barely visible" for 9 
positive and 8 negative tests 


Indeterminate results (reference standard): none reported 


Unit of analysis: not reported, but samples tested on day of collection so considered 
to be 1 per participant 


Funding: no funding sources reported 
Publication status: accepted manuscript 
Source: Journal of Clinical Microbioloby 


Author COI: no conflict of interest statement reported 


Authors' judgement Risk of bias Applicability concerns 


Unclear 


Yes 
Unclear 
Unclear 


Unclear risk 


Unclear 


Unclear 


Yes 


Unclear risk 
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Lambert-Niclot 2020 (continued) 


Are there concerns that the index test, its 
conduct, or interpretation differ from the 
review question? 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly 
classify the target condition? 


Were the reference standard results interpret- 
ed without knowledge of the results of the in- 
dex tests? 


Reference standard does not incorporate re- 
sult of index test? 


Could the reference standard, its conduct, 
or its interpretation have introduced bias? 


Are there concerns that the target condi- 
tion as defined by the reference standard 
does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between in- 
dex test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Did all participants receive a reference stan- 
dard? 


Were results presented per patient? 


Could the patient flow have introduced 
bias? 


Lephart 2020 [A] 


Study characteristics 


Patient Sampling 


Unclear 


No 


Unclear 


Yes 


High risk 


High 


Yes 


Yes 


No 


Yes 


Yes 


High risk 


Single group study including samples from: 
[1] patients presenting to emergency department (n=75), or 


Recruitment: Not stated 


Prospective or retrospective: Not reported 
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Lephart 2020 [A] (continued) 


Patient characteristics and setting 


Index tests 


Target condition and reference standard(s) 


Flow and timing 


[Study also reports results for second group of recovering inpatients with previous- 
ly laboratory-confirmed COVID-19 (n=13); for purposes of this review only those in 
group [1] were included] 


Setting: [1] ED 

Location: Not stated; pathology lab at University of Michigan Medical School 
Country: USA 

Dates: 22 Apr to 5 May 2020 

Symptoms and severity: Not reported 

Demographics: Not reported 


Exposure history: Not reported 


Test name: [A] ID NOW (second index test [B] Xpert Xpress, extracted as Lephart 
2020 [B]; two additional RT-PCR tests evaluated in study but not included in this re- 
view). No product codes reported 


Manufacturer: [A] Abbott Molecular 

Target gene: Not reported in paper 

Test method: [A] isothermal PCR 

Samples used: [A] Nasal; Presume collected by HCP but not reported 

Transport media: [A] None - transported dry swabs in sealed sterile collection bags 
Sample storage: [A] within 24h 

Test operator: Not stated; presume lab staff 


Definition of test positivity: Each assay was performed according to manufacturer’s 
EUA instructions. 


Blinding reported: Not stated; unlikely 


Timing of samples: On presentation; timing pso not reported 


Reference standard: Composite: positive on >=2 of 4 NATs tested considered D+, in- 
cluding [A] ID NOW, [B] Xpert Xpress, [C] Simplexa COVID-19 Direct (Diasorin) (this was 
the standard of care assay), [D] RealTime m2000 SARS-CoV-2 Assay (Abbott Molecu- 
lar) 


Definition of non-COVID cases: Three negatives (on different assays) required for D- 
Genetic target(s): Not stated 
Samples used: NP swabs (Same as for Xpert Xpress) 


Timing of reference standard: Within 24h of sample collection (on presentation at 
ED); no further detail 


Blinded to index test: Not stated; seems unlikely 


Incorporated index test: Yes 


Time interval between index and reference tests: Same swab [B], or paired collection 
[A] 


All patients received same reference standard: Yes, all had all 4 assays 
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Lephart 2020 [A] (continued) 


Comparative 


Notes 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of pa- 
tients enrolled? 


Was a case-control design avoided? 


Did the study avoid inappropriate exclu- 
sions? 


Did the study avoid inappropriate inclu- 
sions? 


Could the selection of patients have intro- 
duced bias? 


Are there concerns that the included pa- 
tients and setting do not match the re- 


view question? 


DOMAIN 2: Index Test (Antigen tests) 


DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test results interpreted with- 
out knowledge of the results of the refer- 
ence standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the 
index test have introduced bias? 


Missing data: None reported, no participant flow diagram reported 
Uninterpretable results: None reported 


Indeterminate results (index test): [A] no invalid results, [B] 1 'invalid' result; not re- 
ported if this was a 'presumptive positive’ (E gene only) on Xpert Xpress or no result 


Indeterminate results (reference standard): None reported 


Unit of analysis: Unclear; text refers to 'patients' so presumed patient-based 


Funding: No funding statement reported 
Publication status: Pre-print 
Source: bioRxiv 


Author COI: No COI statement provided 


Authors' judgement Risk of bias Applicability concerns 
Unclear 
Yes 
Unclear 
Yes 
Unclear risk 


Low concern 


Unclear 


Yes 


Unclear risk 
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Lephart 2020 [A] (continued) 


Are there concerns that the index test, its 
conduct, or interpretation differ from the 
review question? 


Unclear 


DOMAIN 3: Reference Standard 


No 


Is the reference standards likely to correctly 


classify the target condition? 


No 


Were the reference standard results inter- 


preted without knowledge of the results of 
the index tests? 


Reference standard does not incorporate re- 
sult of index test? 


Could the reference standard, its conduct, 
or its interpretation have introduced 
bias? 


No 


High risk 


Are there concerns that the target condi- 


tion as defined by the reference standard 
does not match the question? 


High 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between 
index test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Yes 


No 


Unclear 


Yes 


Did all participants receive a reference stan- 


dard? 


Yes 


Were results presented per patient? 


Could the patient flow have introduced 
bias? 


High risk 


Lephart 2020 [B] 


Study characteristics 


Patient Sampling See Lephart 2020 [A] for full study details and QUADAS entries 


Patient characteris- 
tics and setting 


Index tests Test name: [B] Xpert Xpress (second index test [A] ID NOW, extracted as Lephart 2020 [A], also see see Lephart 
2020 [A] for full study details and QUADAS entries; two additional RT-PCR tests evaluated in study but not in- 


cluded in this review). No product codes reported 


Manufacturer: [B] Cepheid 
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Lephart 2020 [B] (continued) 


Target condition 
and reference stan- 
dard(s) 


Flow and timing 
Comparative 


Notes 


Lieberman 2020 


Study characteristics 


Patient Sampling 


Target gene: Not reported in paper 

Test method: [B] Automated RT-PCR 

Samples used: [B] NP; presume collected by HCP but not reported 
Transport media: [B] M4-RT VTM (Thermo Fisher) 

Sample storage: [B] stored at 4°C and tested within 24h 

Test operator: Not stated; presume lab staff 


Definition of test positivity: each assay was performed according to manufacturer’s EUA instructions (pre- 
sumptive positives not described) 


Blinding reported: Not stated; unlikely 


Timing of samples: On presentation; timing pso not reported 


See Lephart 2020 [A] for full study details and QUADAS entries 


See Lephart 2020 [A] for full study details and QUADAS entries 


Single-group study to estimate sensitivity and specificity: 

- samples submitted for clinical diagnostic testing (n = 169; not all samples analysed for 
all tests) 

Recruitment: not stated 


Prospective or retrospective: retrospective (residual samples) 


Number of samples (samples with confirmed SARS-CoV-2): 169 (87) 


Patient characteristics and setting Setting: not stated; sampled from laboratory 


Location: Washington State Public Health Laboratory 
Country: USA 

Dates: not stated 

Symptoms and severity: not stated 

Demographics: not stated 


Exposure history: not stated 





Index tests Test name: Xpert Xpress 
Manufacturer: Cepheid 
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Lieberman 2020 (continued) 





Antigen target: E, N2 

Antibody: N/A 

Test method: rapid PCR 

Samples used: NP swabs (collection not described) 
Transport media: 300 yL of VTM sample 


Sample storage: all same-sample comparisons were performed on specimens 
stored at 4 °C for < 72 h with no freeze-thaws 


Test operator: not stated; presume laboratory staff 
Common panel of 26 specimens tested at UW by the UW CDC EUA-based LDT or at Lab- 
Corp Seattle 


Definition of test positivity: 1 of 2 targets detected was considered positive for all assays; 
Xpert Xpress data extracted as per IFU definition (positive = both targets or N gene posi- 
tive; E-gene-positive requires retest) 


Blinding reported: not stated 
Timing of samples: not stated 


Also evaluates: 
[B] Hologic Panther Fusion RUO, [C] Hologic Panther Fusion EUA, [D] Diasorin Simplexa, 
[E] Roche cobas 6800 


in same 26 samples and in additional residual specimens (n = 115) at UW (different N per 


test) 
Target condition and reference stan- Reference standard: RT-PCR; UW CDC EUA-based in-house test (positive if 1 of 2 targets 
dard(s) detected - presume at < 40 Ct) 


Definition of non-COVID cases: single negative PCR 
Genetic target(s): NI, N2 

Samples used: NP swabs, as for index test 

Timing of reference standard: not stated 

Blinded to index test: not stated 


Incorporated index test: no 


Flow and timing Time interval between index and reference tests: all testing conducted within 72 h 
All participants received same reference standard: yes 


Missing data: none reported, no participant flow diagram reported; review team exclud- 
ed data for 28 specimens comparing Panther Fusion with DiaSorin Simplexa 


Uninterpretable results: not stated 


Indeterminate results (index test): ‘Inconclusive' results (i.e. 1 genetic target detected) 
were considered positive due to the high specificity of all assays and limited cross-reac- 
tivity seen for SARS-CoV-2 primer sets. For Xpert Xpress only 12/13 were positive accord- 
ing to IFU specifications on first test (both targets present, or N gene positive); on retest- 
ing the presumptive positive became positive (detection of E-gene but not N-gene) 


Indeterminate results (reference standard): as for index test 


Unit of analysis: not stated, only refers to samples 
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Lieberman 2020 (continued) 


Comparative 


Notes 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of 
patients enrolled? 


Was a case-control design avoided? 


Did the study avoid inappropriate exclu- 
sions? 


Did the study avoid inappropriate inclu- 
sions? 


Could the selection of patients have in- 
troduced bias? 


Are there concerns that the included 
patients and setting do not match the 


review question? 


DOMAIN 2: Index Test (Antigen tests) 


Funding: no funding statement reported 
Publication status: accepted manuscript 
Source: Journal of Clinical Microbioloby 


Author COI: no COI statement reported 


Authors' judgement Risk of bias 
Unclear 
Yes 
Unclear 
Unclear 
Unclear risk 


DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test results interpreted 
without knowledge of the results of the 
reference standard? 


If a threshold was used, was it pre-speci- 
fied? 


Could the conduct or interpretation of 
the index test have introduced bias? 


Are there concerns that the index test, 
its conduct, or interpretation differ 
from the review question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to cor- 
rectly classify the target condition? 


Unclear 


Yes 


Unclear risk 


No 


Applicability concerns 


High 


Unclear 
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Lieberman 2020 (continued) 


Were the reference standard results inter- 
preted without knowledge of the results 
of the index tests? 


Reference standard does not incorporate 
result of index test? 


Could the reference standard, its con- 
duct, or its interpretation have intro- 
duced bias? 


Are there concerns that the target con- 
dition as defined by the reference stan- 
dard does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval be- 
tween index test and reference standard? 


Did all patients receive the same refer- 
ence standard? 


Were all patients included in the analysis? 


Did all participants receive a reference 
standard? 


Were results presented per patient? 


Could the patient flow have introduced 
bias? 


Linares 2020 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Unclear 


Yes 


High risk 


High 


Yes 


Yes 


Unclear 


Yes 


Unclear 


Unclear risk 


Single group study estimating sensitivity and specificity, recruiting at two locations: 
[1] symptomatic patients admitted to ED with clinical suspicion of COVID-19 (n=135) 
or asymptomatic patients with history of contact with another COVID-19 patient 
(n=17) 

[2] symptomatic patients (n=50) or asymptomatic (n=55) patients attending one of 
two primary healthcare centres 

Recruitment: Not stated 


Prospective or retrospective: Unclear; appears to be prospective 


Setting: Mixed; A&E or primary care 

Location: Hospital Universitario Principe de Asturias, Madrid 
Country: Spain 

Dates: Sep 10 to Sep 15 


Symptoms and severity: 185, 72% symptomatic 
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Linares 2020 (Continued) 


Index tests 


Target condition and reference standard(s) 


Flow and timing 


ED (n=135): fever 40, dyspnoea 42, cough 22, headache 14 
Prim care (n=50): fever 14, dyspnoea 1, cough 18, headache 17 


Demographics: Mean(?) age (range): ED 51.5y (37.0 to 71.8y); primary care 39.0y 
(25.0 to 56.0y) 
Male: ED 77 (51%), primary care 49 (47%) 


Exposure history: Not stated 


Test name: PanBio COVID-19 Ag Rapid Test Device (no product code) 
Manufacturer: Abbott Rapid Diagnostic Jena GmbH, Jena, Germany 
Antibody: Nucleocapsid 

Antigen target: Not stated 


Test method: Not stated; qualitative membrane-based immunoassay (immunochro- 
matography) 


Samples used: NP; HCW obtained 

Transport media: None reported 

Sample storage: Not stated 

Test operator: Not stated 

Definition of test positivity: Not stated; as per manufacturer 
Blinding reported: Not stated 

Timing of samples: ED: 2 days pso (IQR? 1-5) 

PC: 4 days pso (IQR? 2-8) 


Table 3 reports range of 0 to 27 days post symptom onset or post COVID-19 contact, 
and range of 0 to 16 days for days post symptoms onset for symptomatic cases only 


Reference standard: RT-PCR; Allplex SARS-CoV-2 assay (Seegene, Seoul, South Ko- 
rea); appears to be <40 Ct threshold 


Definition of non-COVID cases: As for cases (single -ve) 
Genetic target(s): Not stated 

Samples used: NP (paired) 

Timing of reference standard: Not stated 

Blinded to index test: Unclear 


Incorporated index test: No 


Time interval between index and reference tests: Paired 
All patients received same reference standard: Yes 


Missing data: None reported however 257 reported in Methods and 255 in Results, 
no participant flow diagram reported 


Uninterpretable results: None reported 
Indeterminate results (index test): None reported 


Indeterminate results (reference standard): None reported 
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Linares 2020 (continued) 


Comparative 


Notes 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of pa- 
tients enrolled? 


Was a case-control design avoided? 
Did the study avoid inappropriate exclusions? 
Did the study avoid inappropriate inclusions? 


Could the selection of patients have intro- 
duced bias? 


Are there concerns that the included pa- 
tients and setting do not match the review 
question? 


DOMAIN 2: Index Test (Antigen tests) 

Were the index test results interpreted with- 
out knowledge of the results of the reference 
standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the 
index test have introduced bias? 


Are there concerns that the index test, its 
conduct, or interpretation differ from the 
review question? 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly 
classify the target condition? 


Unit of analysis: Patients 


Funding: No funding statement provided 
Publication status: Pre-print 
Source: medRxiv 


Author COI: No COI statement provided 


Authors' judgement Risk of bias 


Unclear 


Yes 
Unclear 
Unclear 


Unclear risk 


Unclear 


Yes 


Unclear risk 


No 


Applicability concerns 


Low concern 


Unclear 
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Linares 2020 (continued) 





Were the reference standard results interpret- | Unclear 

ed without knowledge of the results of the in- 

dex tests? 

Reference standard does not incorporate re- Yes 

sult of index test? 

Could the reference standard, its conduct, High risk 

or its interpretation have introduced bias? 

Are there concerns that the target condi- High 

tion as defined by the reference standard 

does not match the question? 

DOMAIN 4: Flow and Timing 

Was there an appropriate interval betweenin- Yes 

dex test and reference standard? 

Did all patients receive the same reference Yes 

standard? 

Were all patients included in the analysis? Unclear 

Did all participants receive a reference stan- Yes 

dard? 

Were results presented per patient? Yes 

Could the patient flow have introduced Unclear risk 

bias? 

Liotti 2020 

Study characteristics 

Patient Sampling Unclear design estimating sensitivity and specificity; residual samples selected from one 
of two virology laboratories at two Covid-19 reference hospitals: 
[1] RT-PCR positive for SARS-CoV-2 (n=104) 
[2] RT-PCR negative for SARS-CoV-2 (n=255) 
Recruitment: Not stated 
Prospective or retrospective: Retrospective 

Patient characteristics and setting Setting: Unclear; laboratory samples 
Location: From authors' institutions: Fondazione Policlinico Universitario A. Gemelli IR- 
CCS, and Istituto Nazionale per le Malattie Infettive (INMI) Lazzaro Spallanzani IRCCS, 
Rome 
Country: Italy 
Dates: Not stated 
Symptoms and severity: Not stated; 
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Liotti 2020 (continued) 





Of SARS-CoV-2 positive samples, 21, 20% high viral load (<25 Ct), 83, 80%low viral load 
(>=25) [28, 27% with Ct >=35] 


Demographics: Not stated 


Exposure history: Not stated 


Index tests Test name: STANDARD F COVID-19 Ag FIA (no product codes reported) 
Manufacturer: SD Biosensor (Suwon, South Korea) 
Antibody: NP 
Antigen target: monoclonal anti-SARS-CoV-2 antibody 
Test method: FIA 
Samples used: NP; collection not reported 
Transport media: Not stated 


Sample storage: performed within 24 hr after collection on samples kept at 4 C until 
testing 


Test operator: Not stated; presume laboratory staff 
Definition of test positivity: As per manufacturer 
Blinding reported: Not stated 


Timing of samples: Not reported 


Target condition and reference stan- Reference standard: RT-PCR (one of 4 assays); Altona Diagnostics RealStar® SARS-CoV-2 
dard(s) RT-PCR, the Seegene Allplex™ 2019-nCoV, the DiaSorin Simplexa™COVID-19 Direct or the 
Roche Diagnostics Cobas® SARS-CoV-2 test 


Definition of non-COVID cases: As for cases (single negative) 
Genetic target(s): Not stated 

Samples used: NP (same as index) 

Timing of reference standard: Not stated 

Blinded to index test: Yes (performed first) 


Incorporated index test: No 


Flow and timing Time interval between index and reference tests: Simultaneous (same swab) 
All patients received same reference standard: Yes 
Missing data: None reported, no participant flow diagram reported 
Uninterpretable results: None reported 


Indeterminate results (index test): None reported; 
FP results were re-tested with Ag assay, 3 of 4 remained positive (all blood contaminat- 
ed) 


Indeterminate results (reference standard): None reported 


Unit of analysis: Not stated 


Comparative 
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Liotti 2020 (continued) 





Notes Funding: Study supported by funds to the Istituto Nazionale per le Malattie Infettive 
(INMI) Lazzaro Spallanzani IRCCS, Rome, Italy, from the Ministero della Salute (Ricer- 
ca Corrente, linea 1; COVID- 2020-12371817), the European Commission e Horizon 2020 
(EU project 101003544 e CoNVat; EU project 101003551 e EXSCALATE4CoV; EU project 
12371675 e EXCALATE4CoV; EU project 101005075 e KRONO) and the European Virus 
Archive e GLOBAL (grants no. 653316 and no. 871029). 


Publication status: Published letter 
Source: Clin Microbiol Infect 


Author COI: All authors report no relevant conflicts of interest 
Methodological quality 
Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of Unclear 
patients enrolled? 


Was a case-control design avoided? Unclear 

Did the study avoid inappropriate exclu- Unclear 

sions? 

Did the study avoid inappropriate inclu- Unclear 

sions? 

Could the selection of patients have in- Unclear risk 


troduced bias? 

Are there concerns that the included Unclear 
patients and setting do not match the 

review question? 

DOMAIN 2: Index Test (Antigen tests) 

Were the index test results interpreted Unclear 

without knowledge of the results of the 


reference standard? 


If a threshold was used, was it pre-speci- Yes 
fied? 


Could the conduct or interpretation of Unclear risk 
the index test have introduced bias? 


Are there concerns that the index test, Unclear 
its conduct, or interpretation differ 
from the review question? 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 





Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 195 
Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 
Collaboration. 


4 Cochra ne Trusted evidence. 
= ° Informed decisions. 
° L I b ra ry Better health, 


Cochrane Database of Systematic Reviews 





Liotti 2020 (continued) 


Is the reference standards likely to cor- No 

rectly classify the target condition? 

Were the reference standard results inter- Yes 

preted without knowledge of the results 

of the index tests? 

Reference standard does notincorporate Yes 

result of index test? 

Could the reference standard, its con- High risk 

duct, or its interpretation have intro- 

duced bias? 

Are there concerns that the target con- High 

dition as defined by the reference stan- 

dard does not match the question? 

DOMAIN 4: Flow and Timing 

Was there an appropriate interval be- Yes 

tween index test and reference standard? 

Did all patients receive the same refer- Yes 

ence standard? 

Were all patients included in the analysis? Unclear 

Did all participants receive a reference Yes 

standard? 

Were results presented per patient? Yes 

Could the patient flow have introduced Unclear risk 

bias? 

Loeffelholz 2020 

Study characteristics 

Patient Sampling Two-group study to estimate sensitivity and specificity for diagnosis of active disease 
- suspected patients referred for COVID-19 testing at 7 sites according to the local criteria (n = 486); sampled 
to enrich for RT-PCR-positive specimens (not further described) 
Recruitment: convenience (in addition, 1 site (LAC+USC) tested specimens from a 4-day point prevalence 
survey of patients presenting with COVID-19 symptoms) 
Prospective or retrospective: retrospective 
Number of samples (samples with confirmed SARS-CoV-2): 486 (220) 

Patient characteris- Setting: not stated 


tics and setting 
Location: 7 sites: 


Johns Hopkins University, Baltimore; 


LAC+USC Medical Centre, University of Southern California, Los Angeles; 
Manchester University NHS Foundation Trust Manchester; 
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Loeffelholz 2020 (continued) 


Index tests 


Target condition 
and reference stan- 
dard(s) 


Mondor Hospital, Paris; 

New York City Dept. Health and Mental Hygiene, NYC; 
Niguarda Hospital, Milan; 

University Hospital, Newark. 


Country: USA, UK, France, Italy 
Dates: 1 March-2 April 2020 
Symptoms and severity: not stated 


Demographics: adults at all sites except New York City Dept. Health and Mental Hygiene and Niguarda Hospi- 
tal where all age groups were tested (ages not stated) 


Exposure history: not stated 


Test name: Cepheid Xpert Xpress SARS-CoV-2 (RUO version, no product code reported) 
Manufacturer: Cepheid Europe 


Antigen target: nucleocapsid gene (N2) and the envelope gene (E) (RUO version also detects RdRp gene but 
this does not contribute to definition of positive) 


Antibody: N/A 
Test method: automated point-of-care PCR 


Samples used: swabs (NP (n = 339), OP (n= 15), combined NP/OP in the same transport vial (n = 97)), and TA 
(n = 30): 


Baltimore - 61 NP 

Los Angeles - 88 NP 

Manchester - 54 NP/OP, 11 NP 

Paris - 68 NP 

NYC - NP 11, OP 15, TA 30, NP/OP 43 
Milan - 79 NP 

Newark - 21 NP 


EO) OV Ge: Se 


Transport media: VTM (swabs), diluted in saline (TA). 1 site (Manchester) pretreated specimens with an equal 
volume (2 30-< 50% (w/w)) of a guanidine hydrochloride buffer and heated at 80 °C 


Sample storage: stored at -80 °C prior to index test, except at 1 site (University Hospital, Newark) where 
specimens were tested in real time, within 2 h by the Xpert test (n = 21). 


Test operator: not stated; presume laboratory staff 


Definition of test positivity: as per manufacturer: if both targets are detected, or if only N2 is detected, the 
test reports a positive result. If only the E target is detected the test reports a presumptive positive result 
"because this target is shared among some members of the sarbecovirus subgenus of coronaviruses". The 
RUO version of the test shows the amplification curves and PCR cycle threshold for all 3 genetic targets. The 
study reports that "The EUA test version cartridge contains the same reagents as the RUO cartridge. The on- 
ly difference between the tests is the software which in the EUA version allows the user to see amplification 
curves and results for the N2 and E targets only". 


Blinding reported: not stated 


Timing of samples: not stated, presume on presentation 


Reference standard: RT-PCR (sites using each kit not reported, added by review team based on number of 
samples per site and per RT-PCR kit) 


1. New York SARS-CoV-2 Real-time Reverse Transcriptase (RT)- PCR Diagnostic Panel; NYC 
2. Quest SARS-CoV-2 rRT-PCR (Quest Diagnostics, San Juan Capistrano, US); Los Angeles 
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Loeffelholz 2020 (continued) 


Flow and timing 


. RealStar® SARS-CoV-2 RT-PCR Kit 1.0 (Altona Diagnostics, Hamburg, Germany); Baltimore and Paris 
. GeneFinder COVID-19 Plus RealAmp Kit (ELITechGroup, Puteaux, France); Milan 

. Allplex 2019-nCoV Assay (Seegene, Seoul, SK); Milan 

. Charité Virology (Berlin, Germany) (in-house); Manchester 

. Abbott RealTime SARS-CoV-2 Assay (Abbott, Des Plaines, US); Newark 

. Simplexa COVID-19 Direct (DiaSorin, Cypress, US); Newark 


OoaON DN HW 


Definition of non-COVID cases: yes (performed prior to index test) 
Genetic target(s): different targets depending on RT-PCR test used: 


. New York Panel; N (N1, N2) 
. Quest; N (N1, N3) 

. RealStar;S,E 

. GeneFinderTM; RdRp, E, N 

. Allplex ; RdRp, E, N 

. Charité Virology; RdRp 

. Abbott RealTime ; RdRp, N 
. Simplexa; ORF1ab, S 


AN nO BP WYN 


Tie-breaker methods (for discrepant results), included: Hologic Panther Fusion (San Diego, USA), Tib-Molbi- 
ol LightMix Modular Wuhan Coronavirus E-gene RT-PCR (Roche, Basel, Switzerland); and the CDC assay (IDT 
primers and probes) 


Samples used: as for index test 
Timing of reference standard: as for index test 
Blinded to index test: no storage; tested in real time 


Incorporated index test: no 


Time interval between index and reference tests: same samples but index performed after frozen storage for 
undefined period of time except at University Hospital, Newark where specimens were tested in real time, 
within 2 h by the Xpert test 


All participants received same reference standard: no 


Missing data: 4 Xpert Xpress test results were lost permanently due to a single instrument computer malfunc- 
tion 


Uninterpretable results: 1 Xpert Xpress test was invalid due to a cartridge error (inadequate sample volume) 


Indeterminate results (index test) presumptive positive results on Xpert Xpress were not reanalysed by Xpert 
Xpress, but all discrepant results were reanalysed by a third RT-PCR method 


Indeterminate results (reference standard): specimens with inconclusive results by a test, and those with dis- 
crepant results between Xpert and the RT-PCR tests were analysed by a third RT-PCR method 

1 FN result was inconclusive on Quest SARS-CoV-2, and negative on CDC RT-PCR; re-considered as TN 

Of 11 FPs (including 1 presumptive positive on Xpert Xpress), 2 were negative on both New York SARS-CoV-2 
and Panther Fusion (remained as FPs), and 9 were negative on in-house RT-PCR but positive on Roche RT- 
PCR (reclassified as TP) 

In addition, 12 specimens (8 NP, 4 NP/OP) were inconclusive by the NY (RT)- PCR Diagnostic Panel and con- 
sidered positive for data analysis purposes in the study. Of these, 11 were positive by the Xpert test and 1 was 
presumptive positive (EUA version of Xpert test). In 4 of these only the N1 target was detected and in 8 only 
the N2 target was detected by the New York EUA method, all with Ct values > 36 

One NP specimen was inconclusive by the Quest SARS-CoV-2 rRT-PCR test and negative by the Xpert test. The 
Quest test reports inconclusive if only a single target (N1 or N3) is detected. They were unable to determine 
which target was detected by the Quest test. This specimen was negative by a tie-breaker NAAT. 


Unit of analysis: not stated; only samples reported 
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Loeffelholz 2020 (continued) 


Comparative 


Notes 


Methodological quality 


Item 


Funding: not stated; presume funded by test manufacturer (see COI statement) 


Publication status: accepted manuscript 


Source: Journal of Clinical Microbiolobyogy 


Author COI: the study was designed and supervised by the sponsor, Cepheid. Data were collected by inves- 
tigators at each study site, and statistical analyses were performed by a Cepheid author. Cepheid authors 


wrote the first draft of the manuscript. All study authors vouch for the accuracy and completeness of the data 


reported. 


Authors' judgement Risk of bias 


DOMAIN 1: Patient Selection 


Was a consecutive or 
random sample of 
patients enrolled? 


Was a case-control 
design avoided? 


Did the study avoid 
inappropriate exclu- 
sions? 


Did the study avoid 
inappropriate inclu- 
sions? 


Could the selection 
of patients have in- 
troduced bias? 


Are there concerns 
that the included 
patients and setting 
do not match the re- 
view question? 


No 


No 


Unclear 


Yes 


High risk 


DOMAIN 2: Index Test (Antigen tests) 


DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test 
results interpreted 
without knowledge 
of the results of the 
reference standard? 


If a threshold was 
used, was it pre- 
specified? 


Unclear 


Yes 


Applicability concerns 


High 
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Loeffelholz 2020 (continued) 


Could the conduct Unclear risk 
or interpretation of 

the index test have 

introduced bias? 


Are there concerns Unclear 
that the index test, 

its conduct, or in- 

terpretation dif- 

fer from the review 

question? 


DOMAIN 3: Reference Standard 


Is the reference stan- No 
dards likely to cor- 

rectly classify the tar- 

get condition? 


Were the reference Yes 
standard results in- 
terpreted without 
knowledge of the 

results of the index 

tests? 


Reference standard Yes 
does not incorporate 
result of index test? 


Could the reference High risk 
standard, its con- 

duct, or its interpre- 

tation have intro- 

duced bias? 


Are there concerns High 
that the target con- 

dition as defined 

by the reference 

standard does not 

match the ques- 

tion? 


DOMAIN 4: Flow and Timing 


Was there an appro- Yes 
priate interval be- 

tween index test and 
reference standard? 


Did all patients re- Yes 
ceive the same refer- 
ence standard? 


Were all patients in- No 
cluded in the analy- 
sis? 
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Loeffelholz 2020 (continued) 


Did all participants Yes 
receive a reference 
standard? 


Were results present- Yes 
ed per patient? 


Could the patient 
flow have intro- 
duced bias? 


Mak 2020 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


High risk 


Single group study to estimate sensitivity alone: 
[1] RT-PCR positive samples selected from Hong Kong's COVID-19 reference labora- 
tory (n=160 samples from 152 patients) 


Recruitment: Convenience; deliberate sampling of specific numbers of different res- 
piratory sample types (selected from cohort of all available positive samples with 
sufficient quantity) 


Prospective or retrospective: Retrospective 


Setting: Not stated 

Location: Public Health Laboratory Services Branch, Hong Kong 
Country: Hong Kong 

Dates: Feb 1 to Apr 21 2020 


Symptoms and severity: Not stated; 
High viral load (<18.57 Ct) - 64, 40% 
‘Normal viral load >18.57 - 96, 60% 


Demographics: Not stated 


Exposure history: Not stated 





Index tests Test name: BIOCREDIT COVID-19 Ag (no product code reported) 
Manufacturer: RapiGEN Inc 
Antibody: Not stated 
Antigen target: Not stated 
Test method: CGIA 
Samples used: throat saliva (TS, n= 45), 
nasopharyngeal swab and 
throat swab (NPS & TS, n=103), nasopharyngeal aspirate and throat 
swab (NPA & TS, n=81), sputum (n=45); no details of collection methods 
Transport media: Samples were placed in viral transport media (VTM) or Phos- 
phate-Buffered Saline (PBS). 100 tL sample volume was used; less viscous samples 
were added directly to sample well of the device, for more viscous samples the swab 
provided with the kit was used to collect the samples and was immersed in the pro- 
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Mak 2020 (continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


vided assay diluent tube. The subsequent procedures were carried out according to 
the manufacturer’s instructions. 


Sample storage: stored at -70 °C until used for study purposes 
Test operator: Not stated; laboratory staff presumed 
Definition of test positivity: Not stated 

Blinding reported: Not stated but all positive samples 


Timing of samples: Not stated 


Reference standard: In-house RT-PCR; <=40Ct 

Definition of non-COVID cases: n/a 

Genetic target(s): RdRp 

Samples used: NPA & TS, NPS & TS, sputum and throat saliva, as for index test 
Timing of reference standard: Not stated 

Blinded to index test: Yes, prior to index test 


Incorporated index test: Not stated 


Time interval between index and reference tests: Simultaneous; same samples 
All patients received same reference standard: Yes 

Missing data: None reported, no participant flow diagram reported 
Uninterpretable results: None reported 

Indeterminate results (index test): None reported 

Indeterminate results (reference standard): None reported 


Unit of analysis: Samples (160 from 152 patients) 


Funding: No funding statement reported 
Publication status: Published 
Source: J Clin Virol 


Author COI: Authors report no CO! 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
Was a consecutive or random sample of pa- No 
tients enrolled? 
Was a case-control design avoided? No 
Did the study avoid inappropriate exclusions? Unclear 
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Did the study avoid inappropriate inclusions? 


Could the selection of patients have intro- 
duced bias? 


Are there concerns that the included pa- 
tients and setting do not match the review 
question? 


DOMAIN 2: Index Test (Antigen tests) 

Were the index test results interpreted with- 
out knowledge of the results of the reference 
standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the 
index test have introduced bias? 


Are there concerns that the index test, its 
conduct, or interpretation differ from the 
review question? 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly 
classify the target condition? 


Were the reference standard results interpret- 
ed without knowledge of the results of the in- 


dex tests? 


Reference standard does not incorporate re- 
sult of index test? 


Could the reference standard, its conduct, 
or its interpretation have introduced bias? 


Are there concerns that the target condi- 
tion as defined by the reference standard 
does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between in- 
dex test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Did all participants receive a reference stan- 
dard? 


Unclear 


High risk 


Unclear 


Yes 


Unclear risk 


Yes 


Yes 


Yes 


Low risk 


Yes 


Yes 


Unclear 


Yes 


Cochrane Database of Systematic Reviews 


High 


High 


High 
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Mak 2020 (continued) 





Were results presented per patient? No 


Could the patient flow have introduced High risk 
bias? 


Mertens 2020 


Study characteristics 


Patient Sampling Single-group study to estimate sensitivity and specificity for diagnosis of active disease: 
- samples from patients suspected of SARS-COV-2 infections (n = 328) 


Recruitment: random sampling of samples submitted to 3 laboratories 
322/328 NP samples (NP swabs) were randomly selected 


Prospective or retrospective: retrospectively 


Number of samples (samples with confirmed SARS-CoV-2): 328 (132) 


Patient characteristics and set- Setting: unclear; samples from university laboratories (discussion states that no outpatient pop- 
ting ulation has been sampled, therefore assume inpatients and HCW samples) 


Location: laboratories at Université Libre de Bruxelles (LHUB-ULB), UZ Leuven and Centre Hospi- 
talier Universitaire Sart-Tilman (CHU) Liége 


Country: Belgium 

Dates: 19-30 March 2020 

Symptoms and severity: not reported 
Demographics: not reported 


Exposure history: unclear; 53/328 samples were from HCW 


Index tests Test name: COVID-19 Ag Respi-Strip 
Manufacturer: Coris BioConcept (Belgium) 
Antigen target: SARS-CoV and SARS-CoV-2 highly conserved nucleoprotein 


Antibody: monoclonal antibodies directed against SARS-CoV and SARS-CoV-2 highly conserved 
nucleoprotein antigen 


Test method: immunochromatographic assay using colloidal gold (CGIA) 
Samples used: remnant respiratory specimens (322 NP swabs, 4 NP aspirate and 2 BAL) 


Transport media: NP: flocked swab + UTM 3 mL (or 1 mL of Amies) (Copan, Brescia, Italy); 
NPA: 3 mL VTM (veal infusion broth (Difco, Becton Dickinson, Sparks, MD, USA) supplemented 
with bovine albumin (Sigma Aldrich, St Louis, MO, USA)) 

BAL: N/A 


Sample storage: not described 
Test operator: laboratory technician 
Definition of test positivity: visible reddish-purple band appearing at the Test line position (T) 


Blinding reported: not stated 
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Mertens 2020 (continued) 


Target condition and reference 
standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Timing of samples: not clear 


Reference standard: qRT-PCR: RealStar SARS-CoV-2 RT-PCR Kit from Altona-diagnostics with a 
cut-off set at 40 Ct (LHUB-ULB); Roche LC480 thermocycler using Taqman Fast Virus 1-Step Mas- 
ter Mix (Thermo Fisher) (Liege); QuantStudio Dx (Thermo Fisher Scientific) or Panther Fusion (PF, 
Hologic, San Diego, USA) (UZ Leuven) 


Definition of non-COVID cases: 


« Genetic target(s): RealStar: not stated; 

* Taqman Fast Virus: RdRp and E genes 

* QuantStudio Dx; "slightly adapted" E-gene 
« Panther Fusion: E gene and ORF1-ab 


Samples used: as for index test (respiratory specimens (322 NP swabs, 4 NP aspirate and 2 BAL) 


Timing of reference standard: not stated; same samples as for index test but analysed at time of 
collection 


Blinded to index test: yes (undertaken for diagnostic purposes at time of collection) 


Incorporated index test: no 


Time interval between index and reference tests: same samples used; discussion report 'some 
delay' between PCR and antigen testing 


All participants received same reference standard: yes but different RT-PCR kits 
Missing data: none reported, no participant flow diagram reported 


Uninterpretable results: none reported; discussion reports some difficulties in visualising the 
strip through the closed tube requiring the lab technician to open the test tube in the laminar air 
flow cabinet and pull out the strip with forceps 


Indeterminate results (index test): weak T lines considered positive 
Indeterminate results (reference standard): none reported 


Unit of analysis: refers to participants 


Funding: not stated 
Publication status: preprint (not peer-reviewed) 
Sourcepreprint server (medRxiv) 


Author COI: the IVD medical device has been developed by the investigator Pascal Mertens, Hen- 
ri Magein, and Justine Bouzet working for Coris BioConcept (potential conflict of interest de- 
clared even though they don’t have any share in this company); Thierry Leclipteux was involved 
in the development of this test and is the CEO of Coris 

Bioconcept (potential conflict of interest declared). All scientific investigators that are external 
to Coris BioConcept declare having no conflict of interest. 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
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Mertens 2020 (continued) 


Was a consecutive or random Yes 
sample of patients enrolled? 


Was a case-control design avoid- Yes 
ed? 


Did the study avoidinappropriate Yes 
exclusions? 


Did the study avoidinappropriate Yes 
inclusions? 


Could the selection of patients 
have introduced bias? 


Are there concerns that the in- 
cluded patients and setting do 
not match the review question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test results inter- Unclear 
preted without knowledge of the 
results of the reference standard? 


If a threshold was used, was it Yes 
pre-specified? 


Could the conduct or interpre- 
tation of the index test have in- 
troduced bias? 


Are there concerns that the in- 
dex test, its conduct, or inter- 
pretation differ from the re- 
view question? 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards like- No 

ly to correctly classify the target 

condition? 

Were the reference standard re- Unclear 


sults interpreted without knowl- 
edge of the results of the index 
tests? 


Reference standard does not in- Yes 
corporate result of index test? 


Could the reference standard, 
its conduct, or its interpreta- 
tion have introduced bias? 


Low risk 


Unclear risk 


High risk 


High 


High 
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Mertens 2020 (continued) 


Are there concerns that the tar- 
get condition as defined by the 
reference standard does not 
match the question? 


DOMAIN 4: Flow and Timing 


High 





Was there an appropriate interval Yes 

between index test and reference 

standard? 

Did all patients receivethesame — Yes 

reference standard? 

Were all patients included in the Unclear 

analysis? 

Did all participants receive a ref- Yes 

erence standard? 

Were results presented per pa- Yes 

tient? 

Could the patient flow have in- Unclear risk 

troduced bias? 

Mitchell 2020 

Study characteristics 

Patient Sampling Single-group study to estimate sensitivity and specificity for diagnosis of active 
disease: 

- samples positive and negative on 1 of 2 SARS-CoV-2 RT-PCR assays 
Recruitment: not stated; suggests possible deliberate sampling of positive cases 
Prospective or retrospective: retrospective (residual samples) 

Number of samples (samples with confirmed SARS-CoV-2): 61 (46) 

Patient characteristics and setting Setting: not stated; 2 independent laboratories (Class Il biosafety cabinet (BSC)) 
Location: not stated; author institutions University of Pittsburgh School of Med- 
icine, Pittsburgh and Laboratory of Viral Diseases, Wadsworth Centre, New York 
State Department of Health, Albany, NY 
Country: USA 
Dates: not stated 
Symptoms and severity: not stated 
Demographics: not stated 
Exposure history: not stated 

Index tests Test name: ID NOW COVID-19 (product code not reported) 

Manufacturer: Abbott, Chicago, USA 
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Mitchell 2020 (continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Item 


Antigen target: not stated 

Antibody: N/A 

Test method: not stated (should be isothermal PCR) 

Samples used: NP samples (residual samples) 

Transport media: VTM; no further detail (no longer covered on IFU) 
Sample storage: stored at -80 t prior to testing 

Test operator: certified laboratory personnel 

Definition of test positivity: not stated; as per manufacturer 
Blinding reported: not stated 


Timing of samples: not stated 


Reference standard: CDC EUA or the New York EUA RT-PCR assays 

Definition of non-COVID cases: single RT-PCR negative 

Genetic target(s): not stated 

Samples used: as for index test 

Timing of reference standard: as for index test 

Blinded to index test: not stated; samples analysed at or near time of collection 


Incorporated index test: no 


Time interval between index and reference tests: same samples but used at dif- 
ferent times (samples used for index test stored at -80 C) 


All participants received same reference standard: no, either the CDC EUA or the 
New York EUA assays 


Missing data: none reported, no participant flow diagram reported 
Uninterpretable results: none reported 

Indeterminate results (index test): none reported 

Indeterminate results (reference standard): none reported 


Unit of analysis: not stated; only samples reported 


Funding: not stated 
Publication status: accepted manuscript 
Source: Journal of Clinical Virology 


Author COI: COI not mentioned by study authors 


Authors' judgement Risk of bias Applicability concerns 
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Mitchell 2020 (continued) 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of patients 
enrolled? 


Was a case-control design avoided? 
Did the study avoid inappropriate exclusions? 
Did the study avoid inappropriate inclusions? 


Could the selection of patients have intro- 
duced bias? 


Are there concerns that the included patients 
and setting do not match the review ques- 
tion? 

DOMAIN 2: Index Test (Antigen tests) 

DOMAIN 2: Index Test (Rapid molecular tests) 
Were the index test results interpreted without 


knowledge of the results of the reference stan- 
dard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the in- 
dex test have introduced bias? 


Are there concerns that the index test, its con- 
duct, or interpretation differ from the review 
question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly 
classify the target condition? 


Were the reference standard results interpret- 
ed without knowledge of the results of the index 
tests? 


Reference standard does not incorporate result 
of index test? 


Could the reference standard, its conduct, or 
its interpretation have introduced bias? 


Are there concerns that the target condition 
as defined by the reference standard does not 


match the question? 


DOMAIN 4: Flow and Timing 


Unclear 


Yes 
Unclear 
Unclear 


Unclear risk 


Unclear 


Yes 


Unclear risk 


Yes 


Yes 


High risk 


High 


High 


High 
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Mitchell 2020 (continued) 


Was there an appropriate interval betweenindex Yes 


test and reference standard? 


Did all patients receive the same reference stan- Yes 


dard? 

Were all patients included in the analysis? Unclear 

Did all participants receive a reference stan- Yes 

dard? 

Were results presented per patient? Unclear 

Could the patient flow have introduced bias? Unclear risk 


Moore 2020 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Index tests 


2-group study to estimate sensitivity and specificity: 
- samples from symptomatic (fever or cough or shortness of breath) adult and paediatric 
outpatients, ED patients, and inpatients 


Recruitment: consecutive (first 94 participants), then all PCR-positive samples plus the next 
PCR-negative sample after each positive sample, to a total of 200 samples 


Prospective or retrospective: retrospective (participant and sample details extracted from 
the electronic medical record) 


Number of samples (samples with confirmed SARS-CoV-2): 200 (125) 


Setting: mixed (outpatients, ED patients and inpatients) 


Location: Rush University Medical Centre (RUMC) or Rush Oak Park Hospital (ROPH), Chica- 
go 


Country: USA 
Dates: 27 March-9 April 2020 


Symptoms and severity: 79 (39.5%) hospitalised including 29 in ICU, 76 (38%) ambulatory 
care including 55 seen in a designated COVID-19 screening clinic), and 45 (23%) seen at ED 


Demographics: mean age 50 years (SD 17 years), 92 (46%) men 


Exposure history: not stated 


Test name: ID NOW (no product code) 

Manufacturer: Abbott 

Antigen target: RdRp 

Antibody: N/A 

Test method: rapid PCR (isothermal) 

Samples used: NP swabs in 3 mL VTM (collection not reported) 


Transport media: M4-RT VTM (Remel, Lenexa, KS) 
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Moore 2020 (Continued) 


Target condition and reference stan- 
dard(s) 


Flow and timing 


Comparative 


Sample storage: stored at 4 °C if all testing could not be completed on the same day; all 
tests completed within 72 h of collection 


Test operator: not stated; presume laboratory staff 
Definition of test positivity: as per manufacturer 
Blinding reported: not stated 


Timing of samples: not stated; presumably on presentation but no information on symp- 
tom status 


Reference standard: RT-PCR; 2 methods used in the study 


1. modified CDC RT-PCR (positive result required Ct < 40 for both targets; negative if neither 
target detected and positive amplification curve for control (RP) gene; inconclusive if only 
1 target detected at Ct < 40, and test repeated) 


2. Abbott RealTime SARS-CoV-2 RT-PCR (amplification curves reported as detected or not 
detected) 


Record review used to verify status of 8 samples positive on RealTime assay and negative 
(6) or inconclusive (2) on CDC assay (all considered disease-positive) 


Definition of non-COVID cases: single RT-PCR negative 
Genetic target(s): 


1. N1,N2 
2. N, RdRp 


Samples used: NP swabs in VTM, as for index test 
Timing of reference standard: not stated 
Blinded to index test: not stated 


Incorporated index test: no 


Time interval between index and reference tests: all 3 tests conducted within 72 h of sam- 
ple collection 


All participants received same reference standard: no? (all received both RT-PCR tests, only 
discordant results on RT-PCR had record review) 


Missing data: none reported, no participant flow diagram reported 
Uninterpretable results: 2 results were invalid on ID NOW and were not retested (excluded) 
Indeterminate results (index test): none reported 


Indeterminate results (reference standard): discordant results between 2 RT-PCR assays 
had record review to determine presence/absence COVID-19 infection 


Unit of analysis: participants (specimens from 200 unique participants) 





Notes Funding: none reported (some reagents supplied from NIH) 
Publication status: preprint 
Source: medRxiv 
Author COI: no COI statement was reported 
Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 211 


Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 


Collaboration. 


Better health. 


+‘ Cochrane 
tw Library 


Trusted evidence. 
Informed decisions. 


Cochrane Database of Systematic Reviews 





Moore 2020 (continued) 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample 
of patients enrolled? 


Was a case-control design avoided? 


Did the study avoid inappropriate ex- 
clusions? 


Did the study avoid inappropriate in- 
clusions? 


Could the selection of patients have 
introduced bias? 


Are there concerns that the includ- 
ed patients and setting do not match 


the review question? 


DOMAIN 2: Index Test (Antigen tests) 


Authors' judgement 


No 


No 


Unclear 


Yes 


DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test results interpret- 
ed without knowledge of the results of 
the reference standard? 


If a threshold was used, was it pre- 
specified? 


Could the conduct or interpretation 
of the index test have introduced 
bias? 


Are there concerns that the index 
test, its conduct, or interpretation 
differ from the review question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to cor- 
rectly classify the target condition? 


Were the reference standard results in- 
terpreted without knowledge of the re- 
sults of the index tests? 


Reference standard does not incorpo- 
rate result of index test? 


Unclear 


Yes 


Yes 


Unclear 


Yes 


Risk of bias 


High risk 


Unclear risk 


Applicability concerns 


High 


High 





Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 
Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 


Collaboration. 


212 


4 Cochra ne Trusted evidence. 
= ° Informed decisions. 
° L I b ra ry Better health, 


Cochrane Database of Systematic Reviews 





Moore 2020 (continued) 


Could the reference standard, its 
conduct, or its interpretation have 
introduced bias? 

Are there concerns that the target 
condition as defined by the refer- 
ence standard does not match the 
question? 

DOMAIN 4: Flow and Timing 

Was there an appropriate interval be- 
tween index test and reference stan- 


dard? 


Did all patients receive the same refer- 
ence standard? 


Were all patients included in the analy- 
sis? 


Did all participants receive a reference 
standard? 


Were results presented per patient? 


Could the patient flow have intro- 
duced bias? 


Moran 2020 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Index tests 


Unclear risk 


Low concern 


Unclear risk 


Single-group study to estimate sensitivity and specificity: 

- specimens collected from inpatients and ambulatory patients at the University 
of Chicago 

Recruitment: not stated 


Prospective or retrospective: not stated 


Number of samples (samples with confirmed SARS-CoV-2): 103 (42) 


Setting: inpatient and ambulatory; samples selected from central laboratory 
Location: Clinical Microbiology Laboratory, University of Chicago 

Country: USA 

Dates: not stated 

Symptoms and severity: not stated 

Demographics: not stated 


Exposure history: not stated 


Test name: Xpert Xpress SARS-CoV-2 assay (no product code) 
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Moran 2020 (continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Manufacturer: Cepheid, Sunnyvale, CA 

Antigen target: E, N (N2 region) 

Antibody: N/A 

Test method: rapid PCR 

Samples used: 8 nasal and 95 NP swabs 

Transport media: none described 

Sample storage: not stated 

Test operator: not stated; presume laboratory staff 


Definition of test positivity: not stated; re-testing using Xpert Xpress was under- 
taken for an N-gene positive result due discrepancy with RT-PCR (not in line with 
IFU recommendation) 


Blinding reported: not stated 


Timing of samples: not stated 


Reference standard: Roche cobas SARS-CoV-2 assay on the cobas 6800 system 
(Roche Molecular Systems, Branchburg, NJ) 


Definition of non-COVID cases: single RT-PCR negative 
Genetic target(s): ORF1, E 

Samples used: nasal and NP swabs; same as for index test 
Timing of reference standard: not stated 

Blinded to index test: not stated 


Incorporated index test: no 


Time interval between index and reference tests: not stated; same sample and 
appear to have both been conducted soon after sample collection 


All participants received same reference standard: yes 
Missing data: none reported, no participant flow diagram reported 
Uninterpretable results: none reported 


Indeterminate results (index test): single FP (negative on E gene and low posi- 
tive on N gene) was retested with Xpert Xpress and considered negative on both 
targets 


Indeterminate results (reference standard): single FP was retested on RT-PCR 
and found to be repeatedly negative 


Unit of analysis: refers to participants 





Notes Funding: none described 
Publication status: accepted manuscript 
Source: Journal of Clinical Microbioloby 
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Moran 2020 (continued) 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of patients 
enrolled? 


Was a case-control design avoided? 
Did the study avoid inappropriate exclusions? 
Did the study avoid inappropriate inclusions? 


Could the selection of patients have introduced 
bias? 


Are there concerns that the included patients 
and setting do not match the review question? 


DOMAIN 2: Index Test (Antigen tests) 
DOMAIN 2: Index Test (Rapid molecular tests) 
Were the index test results interpreted without 
knowledge of the results of the reference stan- 
dard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the in- 
dex test have introduced bias? 


Are there concerns that the index test, its con- 
duct, or interpretation differ from the review 
question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly clas- 
sify the target condition? 


Were the reference standard results interpret- 
ed without knowledge of the results of the index 
tests? 


Reference standard does not incorporate result of 
index test? 


Could the reference standard, its conduct, or 
its interpretation have introduced bias? 


Author COI: no COI statement was reported 


Authors' judgement Risk of bias 


Unclear 


Yes 
Unclear 
Unclear 


Unclear risk 


Unclear 


No 


High risk 


No 


Unclear 


Yes 


High risk 


Applicability concerns 


Unclear 


Unclear 
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Moran 2020 (continued) 





Are there concerns that the target condition High 
as defined by the reference standard does not 
match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between index = Yes 
test and reference standard? 


Did all patients receive the same reference stan- Yes 
dard? 
Were all patients included in the analysis? Unclear 


Did all participants receive areference standard? Yes 
Were results presented per patient? Yes 


Could the patient flow have introduced bias? Unclear risk 


Nagura-Ikeda 2020 





Study characteristics 

Patient Sampling Single group study of patients with laboratory confirmed COVID-19 referred for isolation 
and treatment (n=103); participants had undergone qRT-PCR tests using NP or OP swabs 
collected at public health institutes or hospitals (presumably symptomatic), asympto- 
matic patients were tested as a result of mass-screening due to an outbreak or family 
cluster 
Recruitment: Not stated 
Prospective or retrospective: NR; samples appear to be collected prospectively but states 
that patient information was retrospectively collected from the hospital electronic med- 
ical records. 

Patient characteristics and setting Setting: Inpatient and asymptomatic (admitted or quarantined) 
Location: Self-Defense Forces Central Hospital, Tokyo 
Country: Japan 
Dates: Feb 11 to May 13, 2020 
Symptoms and severity: 88 (85%) symptomatic, including 16 (15%) severe (showing clin- 
ical symptoms of pneumonia - dyspnea, tachypnea, saturation of percutaneous oxygen 
[SpO2] < 93%, and the need for oxygen therapy); 15 (15%) asymptomatic (including 4 pre- 
symptomatic) 
Demographics: IPD provided - median age 46, range 18-87; 66 (64%) male 
Exposure history: Not reported 

Index tests Test name: ESPLINE® SARS-CoV-2 (no product code reported) 
[Five other tests performed including RT-PCR and RT-LAMP, but not eligible for this re- 
view] 
Manufacturer: Fuji Rebio Inc 

Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 216 


Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 
Collaboration. 


e Coch rane Trusted evidence. 
= Lib Informed decisions. 
| iprary Better health. Cochrane Database of Systematic Reviews 


Nagura-Ikeda 2020 (continued) 





Antibody: NP 

Antigen target: Not stated 

Test method: LFA (no reader device required) 

Samples used: Saliva (self-collected) 

Transport media: None; around 500 uL saliva collected 

Sample storage: Stored at -80C until sample preparation 

Test operator: Not stated; implies laboratory staff 

Definition of test positivity: Not stated; appearance of test line implied 
Blinding reported: Not stated 


Timing of samples: saliva collected on admission to hospital; IPD reports this was median 
7 days p.s.o (1-14) 


Target condition and reference stan- Reference standard: RT-qPCR on initial presentation (RT-PCR was conducted on saliva 
dard(s) samples as part of the study but this did not form part of the reference standard diagno- 
sis) 


Definition of non-COVID cases: Single RT-PCR negative 
Genetic target(s): Not reported 
Samples used: NP or OP 


Timing of reference standard: On presentation or as part of mass screening; specific tim- 
ing in regard to symptom onset was not reported for the original RT-PCR and unclear if 
same day as saliva collection 


Blinded to index test: Yes 


Incorporated index test: No 


Flow and timing Time interval between index and reference tests: Unclear; saliva collected on day of ad- 
mission to quarantine/hospital but NP/OP conducted at some point prior to that 


All patients received same reference standard: Yes 

Missing data: Not stated, no participant flow diagram reported 
Uninterpretable results: None reported 

Indeterminate results (index test): None reported 
Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 
Comparative 


Notes Funding: work was supported by the Health, Labour and Welfare Policy Research Grants, 
Research on Emerging and Re-emerging Infectious Diseases and Immunization [grant 
number 20HA2002]. 


Publication status: Accepted manuscript 
Source: J Clin Microbiol 


Author COI: The authors declare that they have no conflicts of interests 
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Nagura-Ikeda 2020 (continued) 
Methodological quality 


Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of 
patients enrolled? 


Was a case-control design avoided? 


Did the study avoid inappropriate exclu- 
sions? 


Did the study avoid inappropriate inclu- 
sions? 


Could the selection of patients have 
introduced bias? 


Are there concerns that the included 
patients and setting do not match the 
review question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test results interpreted 
without knowledge of the results of the 
reference standard? 


If a threshold was used, was it pre-spec- 
ified? 


Could the conduct or interpretation of 
the index test have introduced bias? 


Are there concerns that the index test, 
its conduct, or interpretation differ 
from the review question? 


Authors' judgement Risk of bias 


Unclear 


No 


Unclear 


Yes 


High risk 


Unclear 


Yes 


Unclear risk 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to cor- 
rectly classify the target condition? 


Were the reference standard results in- 
terpreted without knowledge of the re- 
sults of the index tests? 


Reference standard does not incorpo- 
rate result of index test? 


Could the reference standard, its con- 
duct, or its interpretation have intro- 
duced bias? 


Yes 


Yes 


Yes 


Low risk 


Applicability concerns 


High 


High 
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Nagura-Ikeda 2020 (continued) 





Are there concerns that the target High 
condition as defined by the reference 

standard does not match the ques- 

tion? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval be- Unclear 
tween index test and reference stan- 

dard? 

Did all patients receive the same refer- Yes 


ence standard? 


Were all patients included in the analy- Unclear 
sis? 


Did all participants receive a reference Yes 
standard? 


Were results presented per patient? Yes 


Could the patient flow have intro- Unclear risk 
duced bias? 


Nash 2020 


Study characteristics 


Patient Sampling Unclear design to estimate sensitivity and specificity: 
- samples from suspected patients submitted to 'PATH' (ww.path.org) for routine 
COVID diagnosis 
[Second cohort of samples also tested using Spike-based assay; excluded as assay 
requires use of centrifuge) 


Recruitment: Not stated 


Prospective or retrospective: Retrospective 


Patient characteristics and setting Setting: Unclear; samples provided to study authors by PATH (non-profit organisa- 
tion), protocol number 00004244 


Location: Not reported 

Country: Not reported 

Dates: Not reported 

Symptoms and severity: Not reported 
Demographics: Not reported 


Exposure history: Not reported 


Index tests Test name: Direct antigen rapid test (DART™); NP-based 


Manufacturer: E25Bio Inc (Cambridge MA); not yet available 
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Nash 2020 (continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Antibody: NP 

Antigen target: anti-N mouse monoclonal antibodies 

Test method: immunochromatographic paper-based (CGIA) 
Samples used: Nasal; collection not described 

Transport media: Not stated 

Sample storage: banked frozen prior to testing 

Test operator: Not stated; presume lab staff 

Definition of test positivity: Visual line 

Blinding reported: Not stated 


Timing of samples: Not stated 


Reference standard: qRT PCR; ThermoFisher/ AppliedBiosystems TaqPATH COV- 
ID-19 Combo Kit (ThermoFisher, Waltham, MA USA) 


Definition of non-COVID cases: As for cases; single negative PCR required 
Genetic target(s): N, S, and ORFlab genes 

Samples used: Nasal (same swab) 

Timing of reference standard: Not stated 

Blinded to index test: Yes, conducted first 


Incorporated index test: No 


Time interval between index and reference tests: Simultaneous (Same swab) 
All patients received same reference standard: Yes 

Missing data: None reported 

Uninterpretable results: None reported 

Indeterminate results (index test): None reported 

Indeterminate results (reference standard): None reported 


Unit of analysis: Not stated 


Funding: The study is funded, in part, by a Bill and Melinda Gates Foundation Award 
(INV-017872) to E25Bio, Inc. EN is funded by Tufts University DISC Seed Grant. MLN 
is supported by a FAPESP grant (#2020/04836-0) and is a CNPq Research Fellow. 
AFV is supported by a FAPESP Fellow grant (#18/17647-0). GRFC is supported by a 
FAPESP Fellow grant (#20/07419-0). BHGAM 798 is supported by a FAPESP Scholar- 
ship (#19/06572-2). 


Publication status: pre-print 
Source: medRxiv 


Author COI: BN, AB, AR, MB, NS, AG, IB, and BBH are employed by or affiliated with 
E25Bio Inc. (www.e25bio.com), a company that develops diagnostics for epidemic 
viruses. 
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Nash 2020 (continued) 
Methodological quality 


Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of pa- 
tients enrolled? 


Was a case-control design avoided? 
Did the study avoid inappropriate exclusions? 
Did the study avoid inappropriate inclusions? 


Could the selection of patients have intro- 
duced bias? 


Are there concerns that the included pa- 
tients and setting do not match the review 
question? 


DOMAIN 2: Index Test (Antigen tests) 

Were the index test results interpreted with- 
out knowledge of the results of the reference 
standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the 
index test have introduced bias? 


Are there concerns that the index test, its 
conduct, or interpretation differ from the 
review question? 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly 
classify the target condition? 


Were the reference standard results interpret- 


ed without knowledge of the results of the in- 
dex tests? 


Reference standard does not incorporate re- 
sult of index test? 


Could the reference standard, its conduct, 
or its interpretation have introduced bias? 


Are there concerns that the target condi- 
tion as defined by the reference standard 
does not match the question? 


Authors' judgement Risk of bias 


Unclear 


Unclear 
Unclear 
Unclear 


Unclear risk 


Unclear 


Yes 


Unclear risk 


No 


Yes 


Yes 


High risk 


Applicability concerns 


High 


High 


High 
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Nash 2020 (continued) 
DOMAIN 4: Flow and Timing 


Was there an appropriate interval between in- 
dex test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Did all participants receive a reference stan- 
dard? 


Were results presented per patient? 


Could the patient flow have introduced 
bias? 


PHE 2020(a) 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Index tests 


Cochrane Database of Systematic Reviews 





Yes 


Yes 


Unclear 


Yes 


Unclear 


Unclear risk 


Set of studies conducted by PHE and University of Oxford. This extraction relates to a 
two group study estimating sensitivity and specificity: 

[1] residual frozen swabs from PCR+ in-patients (n=200) 

[2] residual fresh swab samples from PCR- patients (n=1000) 

Swabs were sent to PHE Porton Down aafter routine testing 

See other PHE 2020 extractions for other sub-studies of Innova assay 


Recruitment: Unclear 


Prospective or retrospective: Retrospective 


Setting: Unclear; appears to be in-patients (samples obtained from secondary health- 
care setting; cases decsribed as from patients admitted to hsopital) 


Location: John Radcliffe Hospital, Oxford (Ag testing at PHE Porton Down) 
Country: UK 

Dates: March-June 2020 (PCR+); August 2020 (PCR-) 

Symptoms and severity: Not stated 

Demographics: Not stated 


Exposure history: Not stated 


Test name: Innova SARS-CoV-2 Antigen Rapid Qualitative Test 
Manufacturer: Innova Medical Group 

Antibody: Not stated 

Antigen target: Not stated 

Test method: Not stated 


Samples used: Naso- and oropharyngeal swabs 
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PHE 2020(a) (continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Transport media: VTM (1ml) 

Sample storage: Frozen (PCR+); fresh (PCR-) 

Test operator: Laboratory staff 

Definition of test positivity: Visual line; as per manufacturer 
Blinding reported: Not stated 


Timing of samples: Not stated 


Reference standard: RT-PCR; not described. The pre-print supplementary materials 
describes using the 'Roche platform' under the Phase 3b heading, and also provides 
the following text under the Phase 2 evaluation heading "Unless otherwise stated, all 
RT-PCR testing was undertaken on the Roche Cobas® 6800 or 8800 system using their 
proprietary SARS-CoV-2 assay as per manufacturer’s instructions (with off-board lysis 
using AVL buffer (Qiagen) and 5% Triton-X100 (Sigma Aldrich)). This assay detects OR- 
F-1a/b as a SARS-CoV-2 specific target, and the E-gene as a pan-sarbecovirus target." 


Definition of non-COVID cases: single negative PCR 
Genetic target(s): Not stated 

Samples used: Appears to be same sample as for Ag test 
Timing of reference standard: As for index test 

Blinded to index test: Not stated 


Incorporated index test: No 


Time interval between index and reference tests: Same swab 
All patients received same reference standard: Yes 
Missing data: See below, plus 1 void PCR 


Uninterpretable results: Failure rates reported as: [1] 12/212, 6%; [2] 50/1040, 5.1% 
NB remaining samples per group (200 and 990) does not match with final numbers re- 
ported (178 and 940), however no explanation given in report. 


Indeterminate results (index test): Unclear 
Indeterminate results (reference standard): Unclear 


Unit of analysis: Patients 


Funding: PHE evaluation 
Publication status: Published 
Source: Online PHE report 


Author COI: None reported 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
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PHE 2020(a) (continued) 
Was a consecutive or random sample of pa- 
tients enrolled? 


Was a case-control design avoided? 


Did the study avoid inappropriate exclu- 
sions? 


Did the study avoid inappropriate inclu- 
sions? 


Could the selection of patients have intro- 
duced bias? 


Are there concerns that the included pa- 
tients and setting do not match the re- 
view question? 


DOMAIN 2: Index Test (Antigen tests) 
Were the index test results interpreted with- 
out knowledge of the results of the refer- 
ence standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the 
index test have introduced bias? 


Are there concerns that the index test, its 
conduct, or interpretation differ from the 
review question? 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly 
classify the target condition? 


Were the reference standard results inter- 
preted without knowledge of the results of 
the index tests? 


Reference standard does not incorporate re- 
sult of index test? 


Could the reference standard, its conduct, 
or its interpretation have introduced 
bias? 


Are there concerns that the target condi- 
tion as defined by the reference standard 


does not match the question? 


DOMAIN 4: Flow and Timing 


Unclear 


No 


Unclear 


Unclear 


High risk 


Unclear 


Yes 


Unclear risk 


No 


Unclear 


Yes 


High risk 


High 


High 


High 
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PHE 2020(a) (continued) 


Was there an appropriate interval between 
index test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Did all participants receive a reference stan- 
dard? 


Were results presented per patient? 


Could the patient flow have introduced 
bias? 


PHE 2020(b) 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Index tests 


Yes 


Yes 


No 


Yes 


Yes 


High risk 


Set of studies conducted by PHE and University of Oxford. This extraction relates to 
a single group study estimating sensitivity and specificity: 

- samples obtained during a COVID-19 outbreak at a Navy barracks (n=157 samples 
reported in pre-print; 2x2 data provided by study investigators) 

See other PHE extractions for other sub-studies of Innova assay 


Recruitment: Unclear; presume consecutive 


Prospective or retrospective: Retrospective 


Setting: Outbreak investigation 
Location: Not stated 

Country: UK 

Dates: Not stated 

Symptoms and severity: Not stated 
Demographics: Not stated 


Exposure history: Not stated 


Test name: Innova SARS-CoV-2 Antigen Rapid Qualitative Test 
Manufacturer: Innova Medical Group 

Antibody: Not stated 

Antigen target: Not stated 

Test method: Not stated 

Samples used: OP swab used; self-collected 

Transport media: VTM 


Sample storage: Transported at 4C to Porton Down for testing 
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PHE 2020(b) (continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Test operator: Laboratory staff 
Definition of test positivity: Visual line; as per manufacturer 
Blinding reported: Not stated 


Timing of samples: One week after outbreak; no further details 


Reference standard: RT-PCR; not described. The pre-print supplementary materi- 
als describes using the 'Roche platform' under the Phase 3b heading, and also pro- 
vides the following text under the Phase 2 evaluation heading "Unless otherwise 
stated, all RT-PCR testing was undertaken on the Roche Cobas® 6800 or 8800 system 
using their proprietary SARS-CoV-2 assay as per manufacturer’s instructions (with 
off-board lysis using AVL buffer (Qiagen) and 5% Triton-X100 (Sigma Aldrich)). This 
assay detects ORF-1a/b as a SARS-CoV-2 specific target, and the E-gene as a pan-sar- 
becovirus target." 


Definition of non-COVID cases: single negative PCR 
Genetic target(s): Not stated 

Samples used: Appears to be same sample as for Ag test 
Timing of reference standard: As for index test 

Blinded to index test: Not stated 


Incorporated index test: No 


Time interval between index and reference tests: Same swab 
All patients received same reference standard: Yes 
Missing data: None reported 


Uninterpretable results: Failure rate reported as 6/157, 3.8% (Table 4 of pre-print)NB 
resulting no. samples per group (n=151) does not quite match with final number re- 
ported (n=152) 


Indeterminate results (index test): Unclear 
Indeterminate results (reference standard): Unclear 


Unit of analysis: Patients 


Funding: PHE evaluation 
Publication status: Published and unpublished 
Source: Online PHE report, plus additional data provided by evaluation team 


Author COI: None reported 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
Was a consecutive or random sample of pa- Yes 
tients enrolled? 
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PHE 2020(b) (continued) 


Was a case-control design avoided? 
Did the study avoid inappropriate exclusions? 
Did the study avoid inappropriate inclusions? 


Could the selection of patients have intro- 
duced bias? 


Are there concerns that the included pa- 
tients and setting do not match the review 
question? 


DOMAIN 2: Index Test (Antigen tests) 

Were the index test results interpreted with- 
out knowledge of the results of the reference 
standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the 
index test have introduced bias? 


Are there concerns that the index test, its 
conduct, or interpretation differ from the 
review question? 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly 
classify the target condition? 


Were the reference standard results interpret- 


ed without knowledge of the results of the in- 
dex tests? 


Reference standard does not incorporate re- 
sult of index test? 


Could the reference standard, its conduct, 
or its interpretation have introduced bias? 


Are there concerns that the target condi- 
tion as defined by the reference standard 


does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between in- 


dex test and reference standard? 


Did all patients receive the same reference 
standard? 


Yes 
Unclear 
Unclear 


Unclear risk 


Unclear 


Yes 


Unclear risk 


No 


Unclear 


Yes 


High risk 


Yes 


Yes 


Low concern 


High 


High 
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Were all patients included in the analysis? No 

Did all participants receive a reference stan- Yes 

dard? 

Were results presented per patient? Yes 

Could the patient flow have introduced High risk 
bias? 


PHE 2020(c) [non-HCW tested] 





Study characteristics 

Patient Sampling Set of studies conducted by PHE and University of Oxford. This extraction relates to a 
single group study estimating sensitivity and specificity: 
- individuals presenting at a regional COVID-19 testing centre as part of a Phase 4 com- 
munity field service evaluation (n=1946; according to Table 3 of pre-print) 
See other PHE extractions for other sub-studies of Innova assay 
Recruitment: Not stated; presume consecutive 
Prospective or retrospective: Not stated 

Patient characteristics and setting Setting: regional COVID-19 testing centres as part of an NHS Test and Trace service 
evaluation involving the general public 
Location: Not stated 
Country: UK 
Dates: Not stated 
Symptoms and severity: Not stated, presumed 'mainly symptomatic' for purposes of 
review analyses 
Demographics: Not stated 
Exposure history: Not stated 

Index tests Test name: Innova SARS-CoV-2 Antigen Rapid Qualitative Test 
Manufacturer: Innova Medical Group 
Antibody: Not stated 
Antigen target: Not stated 
Test method: Not stated 
Samples used: Anterior nasal and combined oropharyngeal samples 
Transport media: Dry swab 
Sample storage: None; immediate testing 
Test operator: self-trained non-HCW ('Boots' member of staff); described in pre-print as 
an “operator” or as 'self-trained members of the public’. 
Definition of test positivity: Visual line; as per manufacturer 
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PHE 2020(c) [non-HCW tested] (continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Blinding reported: Yes; conducted on site 


Timing of samples: Not stated 


Reference standard: RT-PCR; no details. The pre-print supplementary materials de- 
scribes using the 'Roche platform’ under the Phase 3b heading, and also provides the 
following text under the Phase 2 evaluation heading "Unless otherwise stated, all RT- 
PCR testing was undertaken on the Roche Cobas® 6800 or 8800 system using their pro- 
prietary SARS-CoV-2 assay as per manufacturer’s instructions (with off-board lysis us- 
ing AVL buffer (Qiagen) and 5% Triton-X100 (Sigma Aldrich)). This assay detects OR- 
F-1a/b as a SARS-CoV-2 specific target, and the E-gene as a pan-sarbecovirus target." 


Definition of non-COVID cases: Cases only study 
Genetic target(s): Not stated 

Samples used: Not stated; paired swabs obtained 
Timing of reference standard: As for index test 
Blinded to index test: Not stated 


Incorporated index test: No 


Time interval between index and reference tests: Paired swabs; simultaneous 
All patients received same reference standard: Yes 


Missing data: Initial sample of 1946 reported, 27 failed, leaving 1919 for inclusion, how- 
ever data for only 1686 samples are provided in the pre-print (1314 PCR- in Table 3 and 
372 PCR+ in text pg 7), a difference of 233 samples. 


Uninterpretable results: Failure rate reported as 27/1946 failed, 1.4% 
Indeterminate results (index test): Unclear 
Indeterminate results (reference standard): Unclear 


Unit of analysis: Patients 


Funding: PHE evaluation 
Publication status: Published 
Source: Online PHE report 


Author COI: none reported 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
Was a consecutive or random sample of Yes 
patients enrolled? 
Was a case-control design avoided? Yes 
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PHE 2020(c) [non-HCW tested] (continued) 


Did the study avoid inappropriate exclu- 
sions? 


Did the study avoid inappropriate inclu- 
sions? 


Could the selection of patients have in- 
troduced bias? 


Are there concerns that the included pa- 
tients and setting do not match the re- 
view question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test results interpreted 
without knowledge of the results of the ref- 
erence standard? 


If a threshold was used, was it pre-speci- 
fied? 


Could the conduct or interpretation of 
the index test have introduced bias? 


Are there concerns that the index test, 
its conduct, or interpretation differ from 
the review question? 


Yes 


Yes 


Low risk 


Yes 


Yes 


Low risk 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correct- 
ly classify the target condition? 


Were the reference standard results inter- 
preted without knowledge of the results of 
the index tests? 


Reference standard does not incorporate 
result of index test? 


Could the reference standard, its con- 
duct, or its interpretation have intro- 
duced bias? 


Are there concerns that the target con- 
dition as defined by the reference stan- 
dard does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between 
index test and reference standard? 


No 


Unclear 


Yes 


High risk 


Yes 


Low concern 


High 


High 
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PHE 2020(c) [non-HCW tested] (continued) 





Did all patients receive the same reference Yes 
standard? 


Were all patients included in the analysis? No 


Did all participants receive a reference Yes 


standard? 

Were results presented per patient? Yes 

Could the patient flow have introduced High risk 
bias? 


PHE 2020(d) [HCW tested] 





Study characteristics 

Patient Sampling Set of studies conducted by PHE and University of Oxford. This extraction relates to a single group 
study estimating sensitivity alone: 
- individuals presenting at one of 14 regional drive-through COVID-19 NHS test and trace centres as 
part of the FALCON C-19 (Facilitating Accelerated Clinical validation Of Novel diagnostics for COV- 
ID-19, 20/WA/0169, IRAS 284229) phase 3b study; those with a positive PCR result were asked to re- 
turn for a re-test within 5 days of the original test result. From the originally published report (Nov 
2020) it appears that only participants with samples that were positive on PCR at the second sam- 
pling were included. 
PHE 2020(d) [HCW tested] is for health care worker tested samples, and PHE 2020(d) [Lab tested] is 
for laboratory scientist tested samples 
See other PHE extractions for other sub-studies of Innova assay 
Recruitment: Not stated; presume consecutive 
Prospective or retrospective: Prospective 
Number of samples (cases): 479 (479) ; 267 tested by HCWs, 212 tested by laboratory scientists 

Patient characteristics and Setting: NHS drive through test and trace centres; no further details 

setting 
Location: 14 regional centres 
Country: UK 
Dates: 17 Sept to 23 Oct 2020 
Symptoms and severity: Only described for all 421 included participants in PHE 2020(d) [HCW test- 
ed] and PHE 2020(d) [Lab tested] combined: Suppl Table 2 reports 40 (9.5%) asymptomatic, 59 
(14%) with no data, leaving 322 with >=1 symptom recorded. It is not stated whether symptoms 
were present at the time of the original swab or at the time of the second sampling therefore data 
for the asymptomatic group have not been included in analyses . 
NB: text reports data for 41 asymptomatic and 344 symptomatic from the Phase 3b study (total n= 
385) 
Demographics: For the 421 participants: median age 33 y, 168, 40% male 
Exposure history: Not stated 

Index tests Test name: Innova SARS-CoV-2 Antigen Rapid Qualitative Test 
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PHE 2020(d) [HCW tested] (continued) 


Target condition and refer- 
ence standard(s) 


Flow and timing 


Manufacturer: Innova Medical Group 
Antibody: Not stated 

Antigen target: Not stated 

Test method: Not stated 


Samples used: combined anterior nasal and oropharyngeal swabs (1 stored as a dry swab and 1 
swab placed in VTM; swabs were self-collected 


Transport media: Dry swab 
Sample storage: None; immediate testing (delay to testing at PHE for [B] is unclear) 


Test operator: PHE 2020(d) [HCW tested] HCW on-site, PHE 2020(d) [Lab tested] Laboratory scien- 
tist at PHE 


Definition of test positivity: Visual line; as per manufacturer 
Blinding reported: Yes 


Timing of samples: Not stated 


Reference standard: RT-PCR; no details. The pre-print supplementary materials describes using the 
‘Roche platform’ under the Phase 3b heading, and also provides the following text under the Phase 
2 evaluation heading "Unless otherwise stated, all RT-PCR testing was undertaken on the Roche 
Cobas® 6800 or 8800 system using their proprietary SARS-CoV-2 assay as per manufacturer’s in- 
structions (with off-board lysis using AVL buffer (Qiagen) and 5% Triton-X100 (Sigma Aldrich)). This 
assay detects ORF-1a/b as a SARS-CoV-2 specific target, and the E-gene as a pan-sarbecovirus tar- 
get." 


Definition of non-COVID cases: 
Genetic target(s): Not stated 


Samples used: Appears to be combined NOP swabs in VTM; obtained at same time as second sam- 
pling for Ag testing (5 days after 1st positive PCR) 


Timing of reference standard: As for index test 
Blinded to index test: Not stated 


Incorporated index test: No 


Time interval between index and reference tests: appears to be simultaneous (if 2nd PCR result was 
used). 


All patients received same reference standard: Yes 


Missing data: Initial sample of 267 reported, 27 failed, leaving 240 for inclusion however data for 
only 223 HCW tested samples are provided in the pre-print (text pg 7). The original report (Nov 
2020) documented 16 samples in this cohort that were either PCR- (n=15) or void (n=1) presumably 
at the time of the second sampling (as only PCR+ were invited for Ag testing. Although the numbers 
don't quite add up, it seems likely that this could explain the difference between the 240 and 223 
samples. 


Uninterpretable results: Failure rates reported as: [A] 28/296, 10.4%; [B] 9/221, 4.2% 
Indeterminate results (index test): Unclear 
Indeterminate results (reference standard): Unclear 


Unit of analysis: Patients 
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PHE 2020(d) [HCW tested] (continued) 


Comparative 

Notes 

Methodological quality 

Item Authors' judgement 
DOMAIN 1: Patient Selection 


Was a consecutive or random Yes 
sample of patients enrolled? 


Was a case-control design No 
avoided? 
Did the study avoid inappro- Yes 


priate exclusions? 


Did the study avoid inappro- Yes 
priate inclusions? 


Could the selection of pa- 
tients have introduced bias? 


Are there concerns that the 
included patients and set- 
ting do not match the review 
question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test results in- Yes 
terpreted without knowledge 

of the results of the reference 
standard? 


If athreshold was used, was it Yes 
pre-specified? 


Could the conduct or inter- 
pretation of the index test 
have introduced bias? 


Are there concerns that the 
index test, its conduct, or in- 
terpretation differ from the 
review question? 


DOMAIN 2: Index Test (Rapid molecular tests) 
DOMAIN 3: Reference Standard 


Is the reference standards like- Yes 
ly to correctly classify the tar- 
get condition? 


Risk of bias 


High risk 


Low risk 


Applicability concerns 


High 


Low concern 
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PHE 2020(d) [HCW tested] (continued) 


Were the reference standard 
results interpreted without 
knowledge of the results of the 
index tests? 


Reference standard does not 
incorporate result of index 
test? 


Could the reference stan- 
dard, its conduct, or its inter- 
pretation have introduced 
bias? 


Are there concerns that the 
target condition as defined 
by the reference standard 
does not match the ques- 
tion? 


DOMAIN 4: Flow and Timing 


Was there an appropriate in- 
terval between index test and 
reference standard? 


Did all patients receive the 
same reference standard? 


Were all patients included in 
the analysis? 


Did all participants receive a 
reference standard? 


Were results presented per pa- 
tient? 


Could the patient flow have 
introduced bias? 


PHE 2020(d) [Lab tested] 


Study characteristics 


Patient Sampling 


Unclear 


Yes 


Unclear risk 


High 


No 


Yes 


No 


Yes 


Yes 


High risk 


Set of studies conducted by PHE and University of Oxford. This extraction relates to a single group 
study estimating sensitivity alone: 


- individuals presenting at one of 14 regional drive-through COVID-19 NHS test and trace centres as 
part of the FALCON C-19 (Facilitating Accelerated Clinical validation Of Novel diagnostics for COV- 
ID-19, 20/WA/0169, IRAS 284229) phase 3b study; those with a positive PCR result were asked to re- 
turn for a re-test within 5 days of the original test result. From the originally published report (Nov 
2020) it appears that only participants with samples that were positive on PCR at the second sam- 
pling were included. 


PHE 2020(d) [HCW tested] is for health care worker tested samples, and PHE 2020(d) [Lab tested] is 
for laboratory scientist tested samples 
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PHE 2020(d) [Lab tested] (continued) 


Patient characteristics and 
setting 


Index tests 


Target condition and refer- 
ence standard(s) 


See other PHE extractions for other sub-studies of Innova assay 
Recruitment: Not stated; presume consecutive 
Prospective or retrospective: Prospective 


Number of samples (cases): 479 (479) ; 267 tested by HCWs, 212 tested by laboratory scientists 


Setting: NHS drive trhough test and trace centres; no further details 
Location: 14 regional centres 

Country: UK 

Dates: 17 Sept to 23 Oct 2020 

Symptoms and severity: 


Only described for all 421 included participants in PHE 2020(d) [HCW tested] and PHE 2020(d) [Lab 
tested] combined: Suppl Table 2 reports 40 (9.5%) asymptomatic, 59 (14%) with no data, leaving 
322 with >=1 symptom recorded. It is not stated whether symptoms were present at the time of 
the original swab or at the time of the second sampling therefore data for the asymptomatic group 
have not been included in analyses . 


NB: text reports data for 41 asymptomatic and 344 symptomatic from the Phase 3b study (total n= 
385) 


Demographics: For the 421 participants: median age 33 y, 168, 40% male 


Exposure history: Not stated 


Test name: Innova SARS-CoV-2 Antigen Rapid Qualitative Test 
Manufacturer: Innova Medical Group 

Antibody: Not stated 

Antigen target: Not stated 

Test method: Not stated 


Samples used: combined anterior nasal and oropharyngeal swabs (1 stored as a dry swab and 1 
swab placed in VTM; swabs were self-collected 


Transport media: Dry swab 
Sample storage: None; immediate testing (delay to testing at PHE for [B] is unclear) 


Test operator: PHE 2020(d) [HCW tested] HCW on-site, PHE 2020(d) [Lab tested] Laboratory scien- 
tist at PHE 


Definition of test positivity: Visual line; as per manufacturer 
Blinding reported: Yes for [A] unclear for [B] 


Timing of samples: Not stated 


Reference standard: RT-PCR; no detailsThe pre-print supplementary materials describes using the 
‘Roche platform’ under the Phase 3b heading, and also provides the following text under the Phase 
2 evaluation heading "Unless otherwise stated, all RT-PCR testing was undertaken on the Roche 
Cobas® 6800 or 8800 system using their proprietary SARS-CoV-2 assay as per manufacturer’s in- 
structions (with off-board lysis using AVL buffer (Qiagen) and 5% Triton-X100 (Sigma Aldrich)). This 
assay detects ORF-1a/b as a SARS-CoV-2 specific target, and the E-gene as a pan-sarbecovirus tar- 
get." 
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PHE 2020(d) [Lab tested] (continued) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Definition of non-COVID cases: 
Genetic target(s): Not stated 


Samples used: Appears to be combined NOP swabs in VTM; obtained at same time as second sam- 
pling for Ag testing (5 days after 1st positive PCR) 


Timing of reference standard: As for index test 
Blinded to index test: Not stated 


Incorporated index test: No 


Time interval between index and reference tests: appears to be simultaneous (if 2nd PCR result was 
used). 


All patients received same reference standard: Yes 


Missing data: Initial sample of 212 reported, 9 failed, leaving 203 for inclusion however data for on- 
ly 198 lab scientist tested samples are provided in the pre-print (text pg 7). The original report (Nov 
2020) documented 8 samples in this cohort that were PCR- presumably at the time of the second 
sampling (as only PCR+ were invited for Ag testing. Although the numbers don't quite add up, it 
seems likely that this could explain the difference between the 203 and 198 samples. 


Uninterpretable results: Failure rate reported as: 9/212, 4.2% 
Indeterminate results (index test): Unclear 
Indeterminate results (reference standard): Unclear 


Unit of analysis: Patients 


Funding: PHE evaluation 
Publication status: Published 
Source: Online PHE report 


Author COI: None reported 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
Was a consecutive or random Yes 
sample of patients enrolled? 
Was a case-control design No 
avoided? 
Did the study avoid inappro- Yes 
priate exclusions? 
Did the study avoid inappro- Yes 
priate inclusions? 
Could the selection of pa- High risk 
tients have introduced bias? 
Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 236 


Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 


Collaboration. 


| Coch rane Trusted evidence. 
= Lib Informed decisions. 
1 iprary Better health. Cochrane Database of Systematic Reviews 


PHE 2020(d) [Lab tested] (continued) 





Are there concerns that the High 
included patients and set- 

ting do not match the review 

question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test results in- Unclear 
terpreted without knowledge 

of the results of the reference 

standard? 


If a threshold was used, was it Yes 
pre-specified? 


Could the conduct or inter- Unclear risk 
pretation of the index test 
have introduced bias? 


Are there concerns that the High 
index test, its conduct, or in- 

terpretation differ from the 

review question? 


DOMAIN 2: Index Test (Rapid molecular tests) 
DOMAIN 3: Reference Standard 


Is the reference standards like- Yes 
ly to correctly classify the tar- 
get condition? 


Were the reference standard Unclear 
results interpreted without 

knowledge of the results of the 

index tests? 


Reference standard does not Yes 
incorporate result of index 
test? 


Could the reference stan- Unclear risk 
dard, its conduct, or its inter- 

pretation have introduced 

bias? 


Are there concerns that the High 
target condition as defined 

by the reference standard 

does not match the ques- 

tion? 


DOMAIN 4: Flow and Timing 
Was there an appropriate in- No 


terval between index test and 
reference standard? 





Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 237 


Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 
Collaboration. 


2 Coch rane Trusted evidence. 
e Inf d decisi ; 
if Library — petterheatth. 


Cochrane Database of Systematic Reviews 





PHE 2020(d) [Lab tested] (continued) 


Did all patients receive the 
same reference standard? 


Were all patients included in 
the analysis? 


Did all participants receive a 
reference standard? 


Were results presented per pa- 
tient? 


Could the patient flow have 
introduced bias? 


PHE 2020(e) 


Study characteristics 


Patient Sampling 


Yes 


No 


Yes 


Yes 


Patient characteristics and setting 


Index tests 


High risk 


Set of studies conducted by PHE and University of Oxford. This extraction relates to 
a single group study estimating specificity alone: 

- PHE and hospital staff volunteering for testing (n=538) 

See other PHE extractions for other sub-studies of Innova assay 

Recruitment: Not stated; presume consecutive 


Prospective or retrospective: Not stated 


Setting: Screening 

Location: PHE and John Radcliffe Hospital, Oxford 

Country: UK 

Dates: Not stated 

Symptoms and severity: Not stated; hospital staff described as asymptomatic 
Demographics: Not stated 


Exposure history: Not stated 


Test name: Innova SARS-CoV-2 Antigen Rapid Qualitative Test 

Manufacturer: Innova Medical Group 

Antibody: Not stated 

Antigen target: Not stated 

Test method: Not stated 

Samples used: N OP swab for PHE staff; NP swab for hospital staff. All self-collected 
Transport media: Dry swab 

Sample storage: None; immediate testing 


Test operator: Not stated; presumably laboratory scientist at PHE 
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PHE 2020(e) (continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Definition of test positivity: Visual line; as per manufacturer 
Blinding reported: Unclear 


Timing of samples: Not stated 


Reference standard: RT-PCR; no details (single negative PCR ok for asymptomatic). 
The pre-print supplementary materials describes using the 'Roche platform’ under 
the Phase 3b heading, and also provides the following text under the Phase 2 eval- 

uation heading "Unless otherwise stated, all RT-PCR testing was undertaken on the 
Roche Cobas® 6800 or 8800 system using their proprietary SARS-CoV-2 assay as per 
manufacturer’s instructions (with off-board lysis using AVL buffer (Qiagen) and 5% 

Triton-X100 (Sigma Aldrich)). This assay detects ORF-1a/b as a SARS-CoV-2 specific 

target, and the E-gene as a pan-sarbecovirus target." 


DGenetic target(s): Not stated 

Samples used: Not stated; presume same or paired swab 
Timing of reference standard: As for index test 

Blinded to index test: Not stated 


Incorporated index test: No 


Time interval between index and reference tests: Unclear, may have been a few days 
All patients received same reference standard: Yes 


Missing data: Initial sample of 570 reported (358 hospital staff and 212 PHE staff), 36 
failed (Table 4: 17 hospital staff and 19 PHE staff), leaving 534 for inclusion. Data for 
538 included 


Uninterpretable results: Failure rate reported as 17/358, 4.7% (hospital) 19/212, 
8.9% (PHE) 


Indeterminate results (index test): Unclear 
Indeterminate results (reference standard): Unclear 


Unit of analysis: Patients 


Funding: PHE evaluation 
Publication status: Published 
Source: Online PHE report 


Author COI: none reported 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
Was a consecutive or random sample of pa- Yes 
tients enrolled? 
Was a case-control design avoided? No 
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PHE 2020(e) (continued) 


Did the study avoid inappropriate exclusions? 
Did the study avoid inappropriate inclusions? 


Could the selection of patients have intro- 
duced bias? 


Are there concerns that the included pa- 
tients and setting do not match the review 
question? 


DOMAIN 2: Index Test (Antigen tests) 

Were the index test results interpreted with- 
out knowledge of the results of the reference 
standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the 
index test have introduced bias? 


Are there concerns that the index test, its 
conduct, or interpretation differ from the 
review question? 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly 
classify the target condition? 


Were the reference standard results interpret- 
ed without knowledge of the results of the in- 


dex tests? 


Reference standard does not incorporate re- 
sult of index test? 


Could the reference standard, its conduct, 
or its interpretation have introduced bias? 


Are there concerns that the target condi- 
tion as defined by the reference standard 
does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between in- 
dex test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Yes 
Yes 


High risk 


Unclear 


Yes 


Unclear risk 


Yes 


Unclear 


Yes 


Unclear risk 


Yes 


Yes 


No 


High 


High 


Low concern 





Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 
Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 


Collaboration. 


240 


e Coch rane Trusted evidence. 
= Lib Informed decisions. 
1 iprary Better health. Cochrane Database of Systematic Reviews 


PHE 2020(e) (continued) 





Did all participants receive a reference stan- Yes 
dard? 
Were results presented per patient? Yes 
Could the patient flow have introduced High risk 
bias? 
Porte 2020a 
Study characteristics 
Patient Sampling Two-group study to estimate sensitivity and specificity for diagnosis of active dis- 
ease: 


- samples from suspected COVID-19 cases (n = 1453) with deliberate sampling of 
PCR-positive and negative cases on a 2:1 basis (n = 127) 


Recruitment: convenience sampling 
Prospective or retrospective: retrospectively 


Number of samples (samples with confirmed SARS-CoV-2): 127 (82) 


Patient characteristics and setting Setting: outpatients attending ED at private medical centre (hospital) 
Location: Clinica Alemana, Santiago 
Country: Chile 
Dates: 16-21 March 2020 


Symptoms and severity: cough 94 (74.6%) 

Fever 77 (61.1%) 

Median duration of symptoms of 2 days (IQR 1-4; range 0-12) 

Duration of symptoms: day 0-3 91 (72.2%); day 4-7 27 (22.4%); day = 8 8 (6.3%) 


Demographics: 68 male (53.5%), median age 38 years (IQR 29.5-44; range 1-91) 


Exposure history: not stated 


Index tests Test name: diagnostic Kit for 2019-Novel Coronavirus (2019-nCoV) Ag Test (Cat. N° 
YRLF04401025, lot N° 2002N408) 


Manufacturer: Bioeasy Biotechnology Co., Shenzhen, China 

Antigen target: SARS-CoV-2 nucleocapsid protein 

Antibody: not stated 

Test method: FIA 

Samples used: remnant OP and NP swabs in 3 mL UTM 

Transport media: UTM-RT System, Copan Diagnostics, Murrieta, CA, USA 
Sample storage: stored at 4 °C and tested within 48 h 

Test operator: laboratory technician 


Definition of test positivity: not stated; test "automatically delivers a positive or neg- 
ative qualitative result" 
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Porte 2020a (continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Positive or negative defined qualitatively 
Blinding reported: yes 


Timing of samples: on presentation 
Within 48 h of the PCR test but it doesn't say when PCR test was performed (median 
duration of symptoms reported in D9) 


Reference standard: RT-PCR (COVID-19 Genesig Real-Time PCR assay (Primer Design 
Ltd., Chandler's Ford, UK)); Ct < 40 considered positive 


Definition of non-COVID cases: single RT-PCR negative 

Genetic target(s): not stated 

Samples used: as for index test; same OP and NP swabs used 

Timing of reference standard: median 2 d post symptom onset (IQR 1-4; range 0-12) 
Blinded to index test: yes (index test done within 48 h of PCR test) 


Incorporated index test: no 


Time interval between index and reference tests: same sample used; within 48 h 
All participants received same reference standard: yes 

Missing data: None; partipant flow diagram reported 

Uninterpretable results: not reported 

Indeterminate results (index test): not reported 

Indeterminate results (reference standard): not reported 


Unit of analysis: participants 


Funding: this work did not receive funding 
Publication status: preprint (not peer-reviewed) 
Source: SSRN 


Author COI: all study authors declare no competing interests 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
Was a consecutive or random sample of pa- No 
tients enrolled? 
Was a case-control design avoided? No 
Did the study avoid inappropriate exclusions? Unclear 
Did the study avoid inappropriate inclusions? Yes 
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Porte 2020a (continued) 


Could the selection of patients have intro- 
duced bias? 


Are there concerns that the included pa- 
tients and setting do not match the review 
question? 


DOMAIN 2: Index Test (Antigen tests) 

Were the index test results interpreted with- 
out knowledge of the results of the reference 
standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the 
index test have introduced bias? 


Are there concerns that the index test, its 
conduct, or interpretation differ from the 
review question? 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly 
classify the target condition? 


Were the reference standard results interpret- 
ed without knowledge of the results of the in- 
dex tests? 


Reference standard does not incorporate re- 
sult of index test? 


Could the reference standard, its conduct, 
or its interpretation have introduced bias? 


Are there concerns that the target condi- 
tion as defined by the reference standard 
does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between in- 
dex test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Did all participants receive a reference stan- 
dard? 


Were results presented per patient? 


High risk 


Yes 


Yes 


Low risk 


No 


Yes 


Yes 


High risk 


Yes 


Yes 


Yes 


Yes 


Yes 


High 


High 


High 
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Porte 2020a (continued) 





Could the patient flow have introduced Low risk 
bias? 
Porte 2020b [A] 
Study characteristics 
Patient Sampling Multi group study to estimate sensitivity and specificity: 


(1) Covid-19 patients presenting within 5 days of symptom onset (n=32) 

(2) symptomatic patients with negative PCR (n=20) 

(3) asymptomatic patients screened prior to surgery (n=12) 

[27 PCR+ and 19 PCR- samples were used in Weitzel 2020 (different assays) ] 
Recruitment: Not stated; appears to be convenience 


Prospective or retrospective: Retrospective 


Patient characteristics and setting Setting: Private clinic (classed as Emergence Dept) 
Location: Clinica Alemana, Santiago 
Country: Chile 
Dates: Not stated 
Symptoms and severity: Not reported; 12 asymptomatic 


Demographics: Total sample 
median age 39 y (IQR 36.7-57); 33, 52% male 


Exposure history: Not reported 


Index tests Comparative study of two Ag tests (no product codes reported); Porte 2020b [A] data 
relate to test [A], see Porte 2020b [B] tests [B] data. 


[A] SOFIA SARS Antigen FIA 
[B] STANDARD® F COVID-19 Ag FIA 


Manufacturer: 


[A] Quidel Corporation, San Diego, CA, USA 
[B] SD Biosensor Inc, Gyeonggi-do, Republic of Korea 


Antibody: NP (both) 

Antigen target: Not stated 

Test method: Both FIA 

Samples used: naso-oropharyngeal flocked swabs; obtained by trained personnel 
Transport media: UTM-RT® System, Copan Diagnostics 

Sample storage: stored at -80 degrees C following RT-PCR 

Test operator: Laboratory staff 

Definition of test positivity: As per manufacturer; both using analyzer device 
Blinding reported: Yes; blinded to RT-PCR result 


Timing of samples: All <5 days p.s.o; median 
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Porte 2020b [A] (continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


PCR+: 2 days (IQR 1-3); PCR-: 1 day (IQR 0.75-4) 


Reference standard: RT-PCR; COVID-19 Genesig®, Primerdesign Ltd., Chandler ’s 
Ford, UK; 
(Ct) values <40 were considered positive 


Definition of non-COVID cases: As for cases 
Genetic target(s): Not stated 

Samples used: NOP; as for index test 
Timing of reference standard: Not stated 
Blinded to index test: Unclear 


Incorporated index test: No 


Time interval between index and reference tests: Simultaneous; same sample 
All patients received same reference standard: Yes 

Missing data: None reported, no participant flow diagram reported 
Uninterpretable results: None reported 

Indeterminate results (index test): None reported 

Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 


Funding: This research did not receive any specific grant from funding agencies in 
the public, commercial, or not-for-profit sectors. 


Publication status: Published 
Source: Int J Infect Dis 


Author COI: All authors declare no competing interests 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
Was a consecutive or random sample of pa- No 
tients enrolled? 
Was a case-control design avoided? No 
Did the study avoid inappropriate exclusions? Unclear 
Did the study avoid inappropriate inclusions? | Unclear 
Could the selection of patients have intro- High risk 
duced bias? 
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Porte 2020b [A] (continued) 


Are there concerns that the included pa- 
tients and setting do not match the review 
question? 


DOMAIN 2: Index Test (Antigen tests) 

Were the index test results interpreted with- 
out knowledge of the results of the reference 
standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the 
index test have introduced bias? 


Are there concerns that the index test, its 
conduct, or interpretation differ from the 
review question? 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly 
classify the target condition? 


Were the reference standard results interpret- 
ed without knowledge of the results of the in- 
dex tests? 


Reference standard does not incorporate re- 
sult of index test? 


Could the reference standard, its conduct, 
or its interpretation have introduced bias? 


Are there concerns that the target condi- 
tion as defined by the reference standard 
does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between in- 
dex test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Did all participants receive a reference stan- 
dard? 


Were results presented per patient? 


Could the patient flow have introduced 
bias? 


Yes 


Yes 


Low risk 


No 


Unclear 


Yes 


High risk 


Yes 


Yes 


Unclear 


Yes 


Yes 


Unclear risk 


High 


High 


High 
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Porte 2020b [B] 


Study characteristics 
Patient Sampling 


Patient characteris- 
tics and setting 


Index tests 


Target condition 
and reference stan- 
dard(s) 


Flow and timing 
Comparative 


Notes 


Rhoads 2020 


Study characteristics 


Patient Sampling 


Comparative study of two Ag tests; Porte 2020b [A] reports full study characteristics and QUADAS 


Comparative study of two Ag tests (no product codes reported); Porte 2020b [B] data relate to test [B], see 
Porte 2020b [A] for data relate to test [A] and QUADAS entries 


[A] SOFIA SARS Antigen FIA 
[B] STANDARD® F COVID-19 Ag FIA 


Manufacturer: 


[A] Quidel Corporation, San Diego, CA, USA 
[B] SD Biosensor Inc, Gyeonggi-do, Republic of Korea 


Antibody: NP (both) 

Antigen target: Not stated 

Test method: Both FIA 

Samples used: naso-oropharyngeal flocked swabs; obtained by trained personnel 
Transport media: UTM-RT® System, Copan Diagnostics 

Sample storage: stored at -80 degrees C following RT-PCR 

Test operator: Laboratory staff 

Definition of test positivity: As per manufacturer; both using analyzer device 
Blinding reported: Yes; blinded to RT-PCR result 


Timing of samples: All <5 days p.s.o; median 
PCR+: 2 days (IQR 1-3); PCR-: 1 day (IQR 0.75-4) 


Comparative study of two Ag tests; Porte 2020b [A] reports full study characteristics and QUADAS 


Comparative study of two Ag tests; Porte 2020b [A] reports full study characteristics and QUADAS 


Single-group study to estimate sensitivity: 
- samples positive using standard of care testing (n = 96) 
(14 negative controls (UTM) included to control for carry-over contamination only) 


Recruitment: convenience 
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Rhoads 2020 (continued) 





Prospective or retrospective: retrospective (remnant samples) 


Number of samples (samples with confirmed SARS-CoV-2): 96 (96) 


Patient characteristics and setting Setting: not stated; includes self-collected and provided-collected samples 


Location: not stated; author institutions University Hospitals Cleveland Medical 
Centre 
and Case Western Reserve University 


Country: USA 

Dates: not stated 

Symptoms and severity: not stated 
Demographics: not stated 


Exposure history: not stated 


Index tests Test name: ID NOW (product codes not reported) 


Manufacturer: Abbott; Chicago, USA 
Also reports evaluation of Diasorin Simplexa (not eligible for this review) 


Antigen target: not stated 
Antibody: N/A 
Test method: isothermal PCR 


Samples used: nasal swabs (self-collected) and NP swabs (provider collected); all 
remnant samples 


Transport media: nasal swabs (2 mL normal saline) and NP swabs (3 mL UTM) 
Sample storage: not stated 

Test operator: not stated; presume laboratory staff 

Definition of test positivity: not stated; as per manufacturer 

Blinding reported: not stated 


Timing of samples: not stated 


Target condition and reference standard(s) Reference standard: standard of care testing for original samples; remnant samples 
re-tested with modified CDC RT-PCR (using 7500 Fast instrument and using alternate 
RNA extraction method (Maxwell RSC 6 instrument with Viral TNA Kit (Cat# AS1330; 
Promega, Madison, USA)); samples with 1 positive target detected considered posi- 
tive instead of "inconclusive" 


Definition of non-COVID cases: as for index test 
Genetic target(s): N1 and N2 

Samples used: as for index test 

Timing of reference standard: as for index test 
Blinded to index test: as for index test 


Incorporated index test: as for index test 


Flow and timing Time interval between index and reference tests: same samples used 
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Rhoads 2020 (continued) 


Comparative 


Notes 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of pa- 
tients enrolled? 


Was a case-control design avoided? 
Did the study avoid inappropriate exclusions? 
Did the study avoid inappropriate inclusions? 


Could the selection of patients have intro- 
duced bias? 


Are there concerns that the included pa- 
tients and setting do not match the review 


question? 


DOMAIN 2: Index Test (Antigen tests) 


DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test results interpreted with- 
out knowledge of the results of the reference 
standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the 
index test have introduced bias? 


All participants received same reference standard: yes 

Missing data: none reported, no participant flow diagram reported 
Uninterpretable results: none reported 

Indeterminate results (index test): none reported 


Indeterminate results (reference standard): RT-PCR detected only 1 of 2 targets for 
2 samples (both considered positive (diagnosed as positive on original sample test- 
ing); both were negative on index test) 


Unit of analysis: not stated; only samples reported 


Funding: no outside funding used to support the investigation 
Publication status: accepted manuscript 
Source: Journal of Clinical Microbioloby 


Author COI: COI not mentioned by study authors 


Authors' judgement Risk of bias Applicability concerns 


No 


No 
Unclear 
Unclear 


High risk 


High 


Unclear 


Yes 


Unclear risk 
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Rhoads 2020 (continued) 


Are there concerns that the index test, its 
conduct, or interpretation differ from the 
review question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly 
classify the target condition? 


Were the reference standard results interpret- 
ed without knowledge of the results of the in- 
dex tests? 


Reference standard does not incorporate re- 
sult of index test? 


Could the reference standard, its conduct, 
or its interpretation have introduced bias? 


Are there concerns that the target condi- 
tion as defined by the reference standard 
does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between in- 
dex test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Did all participants receive a reference stan- 
dard? 


Were results presented per patient? 


Could the patient flow have introduced 
bias? 


Schildgen 2020 [A] 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


High 


Yes 


Unclear 


Yes 


Unclear risk 


High 


Yes 


Yes 


Unclear 


Yes 


Unclear 


Unclear risk 


Unclear design; appears to be single cohort with deliberate sampling of PCR+/ 
PCR-: 

[1] RT-PCR positive BAL or throat wash samples (n=42) 

[2] RT-PCR negative samples (n=31) 

Described as pilot sample panel 


Recruitment: Appears to be convenience 


Prospective or retrospective: Not stated; presume retrospective 


Setting: Not stated 
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Schildgen 2020 [A] (continued) 


Index tests 


Target condition and reference standard(s) 


Flow and timing 


Location: Authors institution: Kliniken der Stadt Koln gGmbH (Koln city clinics) 
Country: Germany 
Dates: Not stated 


Symptoms and severity: Not stated for BAL samples, throat wash from 23 symp- 
tomatic and 27 asymptomatic people. 


Demographics: Not stated 


Exposure history: Not stated 


Comparative study of three Ag tests (no product codes reported); Schildgen 
2020 [A] data relate to test [A], see Schildgen 2020 [B] and Schildgen 2020 [C] for 
data relate to tests [B] and [C]. 


Test name: 


[A] BIOCREDIT 
[B] Panbio 
[C] SARS-CoV-2 Rapid Antigen test 


Manufacturer: 


[A] RapiGEN 
[B] Abbott 
[C] Roche 





Antibody: Not stated 

Antigen target: Not stated 

Test method: All LFA 

Samples used: BAL (n=13); throat wash (n=50, including 27 from asymptomatic) 
Transport media: Not stated 

Sample storage: Not stated 

Test operator: Not stated; presume lab staff 

Definition of test positivity: As per manufacturer 

Blinding reported: Not stated 


Timing of samples: Not stated 


Reference standard: RT-PCR; RealStar® SARS-CoV-2 RT-PCR Kit, Altona, Germany 
Definition of non-COVID cases: As for cases 

Genetic target(s): Not stated 

Samples used: BAL or throat wash; As per index test 

Timing of reference standard: Not stated 

Blinded to index test: Not stated 


Incorporated index test: No 


Time interval between index and reference tests: Same swab 


All patients received same reference standard: Yes 
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Schildgen 2020 [A] (continued) 





Missing data: 8 PCR invalid samples also tested; 2/8 invalid in one AG assay 
each, 3/8 negative in all 3 Ag assays 


Uninterpretable results: None reported 
Indeterminate results (index test): None reported 
Indeterminate results (reference standard): None reported 


Unit of analysis: Unclear 
Comparative 


Notes Funding: The study did not receive any external funding 
Publication status: preprint 
Source: medRxiv 


Author COI: The authors declare that they have no conflicts of interest 
Methodological quality 
Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of patients No 
enrolled? 


Was a case-control design avoided? No 
Did the study avoid inappropriate exclusions? Unclear 
Did the study avoid inappropriate inclusions? Unclear 


Could the selection of patients have introduced High risk 
bias? 


Are there concerns that the included patients High 
and setting do not match the review question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test results interpreted without Unclear 

knowledge of the results of the reference stan- 

dard? 

If a threshold was used, was it pre-specified? Yes 

Could the conduct or interpretation of the in- Unclear risk 


dex test have introduced bias? 
Are there concerns that the index test, its con- High 
duct, or interpretation differ from the review 


question? 


DOMAIN 2: Index Test (Rapid molecular tests) 
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Schildgen 2020 [A] (Continued) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly clas- No 
sify the target condition? 


Were the reference standard results interpret- Unclear 
ed without knowledge of the results of the index 


tests? 


Reference standard does not incorporate result of Yes 


index test? 


Could the reference standard, its conduct, or High risk 
its interpretation have introduced bias? 


Are there concerns that the target condition High 
as defined by the reference standard does not 


match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between index Yes 
test and reference standard? 


Did all patients receive the same reference stan- Yes 
dard? 
Were all patients included in the analysis? No 


Did all participants receive a reference standard? _— Yes 


Were results presented per patient? Unclear 


Could the patient flow have introduced bias? High risk 


Schildgen 2020 [B] 


Study characteristics 
Patient Sampling 


Patient characteris- 
tics and setting 


Index tests 


Comparative study of three Ag tests; Schildgen 2020 [A] reports full study characteristics and QUADAS 


Comparative study of three Ag tests; Schildgen 2020 [A] reports full study characteristics and QUADAS 


Comparative study of three Ag tests (no product codes reported); Schildgen 2020 [B] data relate to test [B], see 
Schildgen 2020 [A] and Schildgen 2020 [C] for data relate to tests [A] and [C], and for QUADAS entries. 


Test name: 


[A] BIOCREDIT 
[B] Panbio 
[C] SARS-CoV-2 Rapid Antigen test 


Manufacturer: 


[A] RapiGEN 
[B] Abbott 
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Schildgen 2020 [B] (Continued) 


Target condition 
and reference stan- 
dard(s) 


Flow and timing 


[C] Roche 

Antibody: Not stated 

Antigen target: Not stated 

Test method: All LFA 

Samples used: BAL (n=13); throat wash (n=50, including 27 from asymptomatic) 
Transport media: Not stated 

Sample storage: Not stated 

Test operator: Not stated; presume lab staff 

Definition of test positivity: As per manufacturer 

Blinding reported: Not stated 


Timing of samples: Not stated 


Comparative study of three Ag tests; Schildgen 2020 [A] reports full study characteristics and QUADAS 


Comparative study of three Ag tests; Schildgen 2020 [A] reports full study characteristics and QUADAS 


Comparative 


Notes 


Schildgen 2020 [C] 


Study characteristics 


Comparative study of three Ag tests; Schildgen 2020 [A] reports full study characteristics and QUADAS 


Patient Sampling 


Patient characteris- 
tics and setting 


Comparative study of three Ag tests; Schildgen 2020 [A] reports full study characteristics and QUADAS 





Index tests Comparative study of three Ag tests (no product codes reported); Schildgen 2020 [C] data relate to test [C], see 

Schildgen 2020 [A] and Schildgen 2020 [B] for data relate to tests [A] and [B], and for QUADAS entries. 
Test name: 
[A] BIOCREDIT 
({B] Panbio 
[C] SARS-CoV-2 Rapid Antigen test 
Manufacturer: 
[A] RapiGEN 
[B] Abbott 
[C] Roche 
Antibody: Not stated 
Antigen target: Not stated 
Test method: All LFA 
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Schildgen 2020 [C] (continued) 
Samples used: BAL (n=13); throat wash (n=50, including 27 from asymptomatic) 





Transport media: Not stated 

Sample storage: Not stated 

Test operator: Not stated; presume lab staff 
Definition of test positivity: As per manufacturer 
Blinding reported: Not stated 


Timing of samples: Not stated 


Target condition Comparative study of three Ag tests; Schildgen 2020 [A] reports full study characteristics and QUADAS 
and reference stan- 

dard(s) 

Flow and timing Comparative study of three Ag tests; Schildgen 2020 [A] reports full study characteristics and QUADAS 


Comparative 


Notes 


Scohy 2020 


Study characteristics 


Patient Sampling Single group study including NP swabs submitted to laboratory at a large ter- 
tiary hospital (n=148) 


Recruitment: Random sample 


Prospective or retrospective: Not stated 


Patient characteristics and setting Setting: Unclear; presume microbiology laboratory takes samples from number 
of sources 


Location: Cliniques universitaires Saint-Luc Hospital, Brussels 

Country: Belgium 

Dates: Apr 6 to Apr 21, 2020 

Symptoms and severity: 86 (58%) symptomatic, 45 (30%) asymptomatic, 17 
(11%) symptom status not reported; 

Cases only: viral load <25 Ct 10 (9%), >=25 Ct 96 (91%) 

Demographics: median age 57.5 (0, 94y); 64 (43%) male 


Exposure history: Not reported 


Index tests Test name: COVID-19 Ag Respi-Strip (product code not reported) 
Manufacturer: Coris Bioconcept 
Antibody: NP 
Antigen target: monoclonal antibody 


Test method: CGIA 





Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 255 
Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 
Collaboration. 


2 Coch rane Trusted evidence. 
= ° Informed decisions. 
“ L | b ra ry Better neath; 


Cochrane Database of Systematic Reviews 





Scohy 2020 (continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Samples used: NP 
Transport media: Not stated 


Sample storage: "If the rapid antigen test was not performed immediately, sam- 
ples were stored at 4 °C until the test" 


Test operator: Not stated 


Definition of test positivity: Visual appearance of T line; also states that "Two 
versions of the test were evaluated. On the second version, conjugate was cou- 
pled on a different way and the control line was optimized." 


Blinding reported: Unclear 


Timing of samples: Not reported 


Reference standard: RT-PCR: genesig® Real-Time PCR assay (Primerdesign Ltd, 
Chandler’s Ford, UK); <40 Ct 


Definition of non-COVID cases: Single PCR negative 
Genetic target(s): RdRp 

Samples used: NP; same as for index 

Timing of reference standard: Not stated 

Blinded to index test: Yes 


Incorporated index test: No 


Time interval between index and reference tests: Same sample 

All patients received same reference standard: Yes 

Missing data: None reported, no participant flow diagram reported 
Uninterpretable results: None reported 

Indeterminate results (index test): None reported 

Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 


Funding: No funding statement reported; COVID-19 Ag Respi-Strip tests provid- 
ed by Coris BioConcept. 


Publication status: Published 
Source: J Clin Virol 


Author COI: The authors declare no conflicts of interest. 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 256 


Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 


Collaboration. 


+‘ Cochrane 
tw Library 


Trusted evidence. 
Informed decisions. 
Better health. 


Cochrane Database of Systematic Reviews 





Scohy 2020 (continued) 


Was a consecutive or random sample of patients 
enrolled? 


Was a case-control design avoided? 
Did the study avoid inappropriate exclusions? 
Did the study avoid inappropriate inclusions? 


Could the selection of patients have introduced 
bias? 


Are there concerns that the included patients 
and setting do not match the review question? 


DOMAIN 2: Index Test (Antigen tests) 

Were the index test results interpreted without 
knowledge of the results of the reference stan- 
dard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the in- 
dex test have introduced bias? 


Are there concerns that the index test, its con- 
duct, or interpretation differ from the review 
question? 

DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly clas- 
sify the target condition? 


Were the reference standard results interpret- 
ed without knowledge of the results of the index 
tests? 


Reference standard does not incorporate result of 
index test? 


Could the reference standard, its conduct, or 
its interpretation have introduced bias? 


Are there concerns that the target condition 
as defined by the reference standard does not 
match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between index 
test and reference standard? 


Yes 


Yes 
Unclear 
Unclear 


Unclear risk 


Unclear 


Yes 


Unclear risk 


No 


Yes 


Yes 


High risk 


Yes 


Unclear 


Unclear 


High 
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Scohy 2020 (continued) 


Did all patients receive the same reference stan- 
dard? 


Were all patients included in the analysis? 
Did all participants receive a reference standard? 
Were results presented per patient? 


Could the patient flow have introduced bias? 


Shrestha 2020 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Index tests 


Yes 


Unclear 
Yes 
Yes 


Unclear risk 


Single group study to estimate sensitivity and specificity: 

- subjects who were close contacts of confirmed cases identified through 
contact tracing, residing in quarantine centre (n=113) 

Recruitment: Convenience 


Prospective or retrospective: Not stated; appears prospective 


Setting: Contact tracing 


Location: Not applicable; author institutions include Shukraraaj Tropical and 
Infectious Disease Hospital, Kathmandu 


Country: Nepal 

Dates: Aug to Sep 2020 

Symptoms and severity: All asymptomatic 
Demographics: Range 13 to 74; 89, 79% male 


Exposure history: All exposed to confirmed case 


Test name: BIOCREDIT 
Manufacturer: RapiGen 
Antibody: Not stated 
Antigen target: Not stated 
Test method: Not stated 
Samples used: NP 
Transport media: None used 


Sample storage: None reported; other sample from the same individual was 
processed for the results as instructed by the manufacturing company of 
antigen kit 


Test operator: Lab technician (trained) 
Definition of test positivity: Visual line; as per manufacturer. 


Blinding reported: Unclear; appears to be Yes 
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Shrestha 2020 (continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Timing of samples: Day 5 of quarantine 


Reference standard: RT-PCR; not detailed, "followed the standard protocol 
regulated by WHO, instruction manual of company and as per NHTC training 
regarding sample collection and transport" 


Definition of non-COVID cases: As for cases; single negative 
Genetic target(s): Not stated 

Samples used: NP in 3mL VTM 

Timing of reference standard: As for index test 

Blinded to index test: Not stated 


Incorporated index test: No 


Time interval between index and reference tests: Simultaneous, paired sam- 
ples 


All patients received same reference standard: Yes 
Missing data: None reported 
Uninterpretable results: None reported 


Indeterminate results (index test): Tests were repeated for samples with 
indistinct outcomes. 


Indeterminate results (reference standard): 


Unit of analysis: Patient 


Funding: No funding statement provided 
Publication status: Published 
Source: KATHMANDU UNIVERSITY MEDICAL JOURNAL 


Author COI: No COI statement provided 





Item Authors' judgement Risk of bias Applicability con- 
cerns 
DOMAIN 1: Patient Selection 
Was a consecutive or random sample of patientsen- No 
rolled? 
Was a case-control design avoided? Yes 
Did the study avoid inappropriate exclusions? Unclear 
Did the study avoid inappropriate inclusions? Unclear 
Could the selection of patients have introduced High risk 
bias? 
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Shrestha 2020 (continued) 


Are there concerns that the included patients and 
setting do not match the review question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test results interpreted without 
knowledge of the results of the reference standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the index 
test have introduced bias? 


Are there concerns that the index test, its con- 
duct, or interpretation differ from the review 
question? 

DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly classify 
the target condition? 


Were the reference standard results interpreted 
without knowledge of the results of the index tests? 


Reference standard does not incorporate result of 
index test? 


Could the reference standard, its conduct, or its 
interpretation have introduced bias? 


Are there concerns that the target condition as 


defined by the reference standard does not match 


the question? 
DOMAIN 4: Flow and Timing 


Was there an appropriate interval between index 
test and reference standard? 


Did all patients receive the same reference stan- 
dard? 


Were all patients included in the analysis? 
Did all participants receive a reference standard? 
Were results presented per patient? 


Could the patient flow have introduced bias? 


Yes 


Yes 


Low risk 


No 


Unclear 


Yes 


High risk 


Yes 


Yes 


Unclear 
Yes 
Yes 


Unclear risk 


Low concern 


High 


High 
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Smithgall 2020 [A] 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Index tests 


Target condition and reference standard(s) 


Two-group study to estimate sensitivity and specificity: 
- patients undergoing routine clinical testing by RT-PCR (n = 113) 


Recruitment: unclear; describes deliberate sampling of samples with high, medium 
and low Ct values on the reference standard RT-PCR 


Prospective or retrospective: unclear; residual swabs used but testing undertaken 
within 48 h of sample collection 


Number of samples (samples with confirmed SARS-CoV-2): 113 (88) 


Setting: inpatient and ED (n from each not reported) 

Location: not stated; author institution is Columbia University Irving Medical Centre 
Country: USA 

Dates: 8-13 April 2020 

Symptoms and severity: not stated 


Demographics: 111 adult (range 23-101 years; average 65 years for RT-PCR-positive 
and 43 years for RT-PCR-negative); 2 paediatric (age 1 day and 5 days) 
61, 54% male 


Exposure history: not stated 


Test name: 


[A] ID NOW (see Smithgall 2020 [B] for details of comparator test) 
(product codes not reported) 


Manufacturer: [A] Abbott 
Antigen target: [A] RdRp gene 
Antibody: N/A 


Test method: [A] isothermal PCR 
Samples used: residual NP swabs (collection not described) 


Transport media: 3 mL VTM (M4RT VTM; ThermoFisher Scientific, Waltham, MA) or 
UTM (UTM; Becton Dickinson and Co., Franklin Lakes, NJ) 


Sample storage: stored at 4 °C; testing completed within 48 h of sample collection 
Test operator: not stated; presume laboratory staff 

Definition of test positivity: automated as per manufacturer 

Blinding reported: not stated 


Timing of samples: not stated; presume on admission or presentation at ED 


Reference standard: RT-PCR with cobas SARS-CoV-2 assay on the 6800 platform 
(Roche Diagnostics, Indianapolis, IN); threshold not stated, all Ct values < 37 on both 
target genes 


Definition of non-COVID cases: not stated; presume single RT-PCR negative 


Genetic target(s): ORF1 a/b, E-gene 
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Smithgall 2020 [A] (continued) 


Flow and timing 


Comparative 


Notes 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of pa- 
tients enrolled? 


Was a case-control design avoided? 
Did the study avoid inappropriate exclusions? 
Did the study avoid inappropriate inclusions? 


Could the selection of patients have intro- 
duced bias? 


Are there concerns that the included pa- 
tients and setting do not match the review 


question? 


DOMAIN 2: Index Test (Antigen tests) 


DOMAIN 2: Index Test (Rapid molecular tests) 


Samples used: as for index test 
Timing of reference standard: as for index test 
Blinded to index test: as for index test 


Incorporated index test: no 


Time interval between index and reference tests: simultaneous; same samples used 
All participants received same reference standard: yes 

Missing data: none reported 

Uninterpretable results: 


Indeterminate results (index test): Xpert: 1 sample was a presumptive positive 
based on detection of E-gene target but not the N2 target 


Indeterminate results (reference standard): none reported 


Unit of analysis: participants 


Funding: none reported 
Publication status: published 
Source: Journal of Clinical Virology 


Author COI: study authors report no conflicts of interest present 


Authors' judgement Risk of bias Applicability concerns 


No 


No 
Unclear 
Unclear 


High risk 


High 
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Smithgall 2020 [A] (continued) 


Were the index test results interpreted with- 
out knowledge of the results of the reference 
standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the 
index test have introduced bias? 


Are there concerns that the index test, its 
conduct, or interpretation differ from the 
review question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly 
classify the target condition? 


Were the reference standard results interpret- 
ed without knowledge of the results of the in- 
dex tests? 


Reference standard does not incorporate re- 
sult of index test? 


Could the reference standard, its conduct, 
or its interpretation have introduced bias? 


Are there concerns that the target condi- 
tion as defined by the reference standard 
does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between in- 
dex test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Did all participants receive a reference stan- 
dard? 


Were results presented per patient? 


Could the patient flow have introduced 
bias? 


Smithgall 2020 [B] 


Study characteristics 


Patient Sampling 


Unclear 


No 


High risk 


No 


Unclear 


Yes 


High risk 


Yes 


Yes 


Unclear 


Yes 


Yes 


Unclear risk 


See Smithgall 2020 [A] for full study details and QUADAS-2 entries 


High 


High 
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Smithgall 2020 [B] (Continued) 


Patient characteris- 
tics and setting 


Index tests 


Target condition 
and reference stan- 
dard(s) 


Flow and timing 
Comparative 


Notes 


SoRelle 2020 


Study characteristics 


Patient Sampling 


See Smithgall 2020 [A] for full study details and QUADAS-2 entries 


Test name: [B] Xpert Xpress (product codes not reported) (see Smithgall 2020 [A] for details of comparator 
test) 


Manufacturer: [B] Cepheid 

Antigen target: [B] N2, E genes 

Antibody: N/A 

Test method: [B] automated RT-PCR 

Samples used: residual NP swabs (collection not described) 


Transport media: 3 mL VTM (M4RT VTM; ThermoFisher Scientific, Waltham, MA) or UTM (UTM; Becton Dickin- 
son and Co., Franklin Lakes, NJ) 


Sample storage: stored at 4 °C; testing completed within 48 h of sample collection. 
Test operator: not stated; presume laboratory staff 


Definition of test positivity: presumptive positive (only E gene present) considered positive (re-testing recom- 
mended on IFU) 


Blinding reported: not stated 


Timing of samples: not stated; presume on admission or presentation at ED 


See Smithgall 2020 [A] for full study details and QUADAS-2 entries 


See Smithgall 2020 [A] for full study details and QUADAS-2 entries 


See Smithgall 2020 [A] for full study details and QUADAS-2 entries 


Unclear design to estimate sensitivity and specificity: 

paired saliva and NP samples from participants symptomatic for COVID-19 
(n=83) 

[Additional saliva samples included for comparison of ID NOW with Xpert 
Xpress; not extracted for this review] 


Recruitment: Not stated 


Prospective or retrospective: Not stated 


Patient characteristics and setting Setting: Unclear 


Location: From authors institutions: University of Texas Southwestern Med- 
ical Center, Dallas 


Country: USA 
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SoRelle 2020 (continued) 


Index tests 


Target condition and reference standard(s) 


Flow and timing 


Dates: Not reported 
Symptoms and severity: Not reported 
Demographics: Not reported 


Exposure history: Not reported 


Test name: ID NOW (no product codes) 
Manufacturer: Abbott Diagnostics 

Antibody: Not stated 

Antigen target: n/a 

Test method: Isothermal PCR 

Samples used: Saliva; collection not described 
Transport media: Not stated 

Sample storage: Not stated 

Test operator: Not stated; presume lab staff 
Definition of test positivity: As per manufacturer 
Blinding reported: Not stated 


Timing of samples: Not stated; chart review of patients with FN results 
against either RT-PCR (NP) Xpert Xpress (Saliva) (n=9) showed 6/9 tested >2 
weeks after symptom onset 


Reference standard: RT-PCR; either Xpert® Xpress SARS-CoV-2 (Cepheid) or 
Abbott RealTime SARS-CoV-2 (Abbott Molecular) RT-PCR assays; n per assay 
is not reported 


Definition of non-COVID cases: As for cases (single negative) 
Genetic target(s): Not stated 

Samples used: NP in VTM (paired) 

Timing of reference standard: Not stated 

Blinded to index test: Not stated 


Incorporated index test: No 


Time interval between index and reference tests: Paired 

All patients received same reference standard: Yes 

Missing data: None reported, no participant flow diagram reported 
Uninterpretable results: None reported 

Indeterminate results (index test): None reported 


Indeterminate results (reference standard): None reported; presumptive pos- 
itives not mentioned 


Unit of analysis: Patients? 
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SoRelle 2020 (continued) 


Comparative 


Notes 


Methodological quality 


Item 


DOMAIN 1: Patient Selection 


Was a consecutive or random sample of patients en- 
rolled? 


Was a case-control design avoided? 
Did the study avoid inappropriate exclusions? 
Did the study avoid inappropriate inclusions? 


Could the selection of patients have introduced 
bias? 


Are there concerns that the included patients and 
setting do not match the review question? 


DOMAIN 2: Index Test (Antigen tests) 
DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test results interpreted without 
knowledge of the results of the reference standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the index 
test have introduced bias? 


Are there concerns that the index test, its con- 
duct, or interpretation differ from the review 
question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly classify 
the target condition? 


Were the reference standard results interpreted 
without knowledge of the results of the index tests? 


Reference standard does not incorporate result of 
index test? 


Funding: No funding statement reported 
Publication status: Published letter 
Source: Clin Chim Acta 


Author COI: No COI statement reported 


Authors' judgement Risk of bias 


Unclear 


Unclear 
Unclear 
Unclear 


Unclear risk 


Unclear 


Yes 


Unclear risk 


No 


Unclear 


Yes 


Applicability con- 
cerns 


Unclear 


High 
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SoRelle 2020 (continued) 


Could the reference standard, its conduct, or its 


interpretation have introduced bias? 


Are there concerns that the target condition as 


defined by the reference standard does not match 


the question? 
DOMAIN 4: Flow and Timing 


Was there an appropriate interval between index 
test and reference standard? 


Did all patients receive the same reference stan- 
dard? 


Were all patients included in the analysis? 
Did all participants receive a reference standard? 
Were results presented per patient? 


Could the patient flow have introduced bias? 


Stevens 2020 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


High risk 
High 

Yes 
Yes 
Unclear 
Yes 
Yes 

Unclear risk 


Unclear design to estimate sensitivity and specificity: 
- selected residual samples from symptomatic and asymptomatic individuals un- 
dergoing routine testing; selected to represent the full range of Ct values 


Recruitment: Convenience 


Prospective or retrospective: Retrospective 


Setting: Unclear; laboratory-based, serving adult and pediatric tertiary care hos- 
pitals 


Location: Stanford Healthcare Virology Laboratory, Stanford 
Country: USA 
Dates: Mar 31 to Apr 7 


Symptoms and severity: Unclear; ‘symptomatic and asymptomatic’; 
Of 54 cases, 10 (19%) were low viral low (Ct>35) 


Demographics: Not reported 


Exposure history: Not reported 





Index tests Test name: Xpert Xpress (no product code) 
Manufacturer: Cepheid Inc 
Antibody: E, N2 
Antigen target: n/a 
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Stevens 2020 (continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Test method: Automated RT-PCR 

Samples used: NP in VTM 

Transport media: VTM (MicroTest M4RT, Remel Inc., San Diego, CA) 

Sample storage: All samples frozen at -80°C prior to testing on the Xpert system 
Test operator: Not stated; presume lab staff 


Definition of test positivity: Presence of N2 +/- E gene; E gene only considered 
presumptive positive 


Blinding reported: Not stated 


Timing of samples: Not stated 


Reference standard: RT-PCR; Panther Fusion SARS-CoV-2 Assay (Hologic, Inc., San 
Diego, CA); interpreted based on the manufacturer’s cycle threshold cut-off value 


Definition of non-COVID cases: As for cases; single negative 
Genetic target(s): Two regions of ORFlab 

Samples used: NP in VTM; as for index test 

Timing of reference standard: Not stated 

Blinded to index test: Yes, conducted first 


Incorporated index test: No 


Time interval between index and reference tests: Same sample 
All patients received same reference standard: Yes 
Missing data: 6 samples excluded due to insufficient sample volume 


Uninterpretable results: 1 RT-PCR positive sample re-tested on Xpert Xpress due 
to initial interpretation of no results (invalid); Xpert +ve on re-test 


Indeterminate results (index test): No presumptive positives were observed 


Indeterminate results (reference standard): 1 RT-PCR positive sample that was 
negative on both targets for Xpert Xpress (FN) was re-tested on Panther Fusion 
and found to be negative (TN) 


Unit of analysis: Unclear 


Funding: No funding statement reported 
Publication status: Accepted manuscript 
Source: J Appl Lab Med 


Author COI: No authors declared any potential conflicts of interest. 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
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Stevens 2020 (Continued) 


Was a consecutive or random sample of patients 
enrolled? 


Was a case-control design avoided? 
Did the study avoid inappropriate exclusions? 
Did the study avoid inappropriate inclusions? 


Could the selection of patients have intro- 
duced bias? 


Are there concerns that the included patients 
and setting do not match the review ques- 
tion? 


DOMAIN 2: Index Test (Antigen tests) 
DOMAIN 2: Index Test (Rapid molecular tests) 
Were the index test results interpreted without 
knowledge of the results of the reference stan- 
dard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the in- 
dex test have introduced bias? 


Are there concerns that the index test, its con- 
duct, or interpretation differ from the review 
question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly 
classify the target condition? 


Were the reference standard results interpret- 
ed without knowledge of the results of the index 
tests? 


Reference standard does not incorporate result 
of index test? 


Could the reference standard, its conduct, or 
its interpretation have introduced bias? 


Are there concerns that the target condition 
as defined by the reference standard does not 
match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between index 
test and reference standard? 


No 


Unclear 
Unclear 
Unclear 


High risk 


Unclear 


Yes 


Unclear risk 


No 


Yes 


Yes 


High risk 


Yes 


High 


High 


High 
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Stevens 2020 (continued) 


Did all patients receive the same reference stan- 
dard? 


Were all patients included in the analysis? 


Did all participants receive a reference stan- 
dard? 


Were results presented per patient? 


Could the patient flow have introduced bias? 


Szymczak 2020 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Yes 


No 


Yes 


Unclear 


High risk 


Single group study to estimate sensitivity and specificity: 

- remnant samples from patients with symptomatic diarrhea submitted for rou- 
tine diagnostic testing (n=79 from 77 patients) 

Recruitment: Convenience 


Prospective or retrospective: Retrospective 


Setting: Unclear 


Location: Clinical Microbiology Laboratory at Montefiore Medical Center, New 
York 


Country: USA 

Dates: Apr 21 to May 15 2020 

Symptoms and severity: All symptomatic for diarrhoea 
Demographics: Not stated 


Exposure history: Not stated 





Index tests Test name: Xpert Xpress (no product code reported) 

Manufacturer: Cepheid Inc 
Target gene(s): N2 and E 
Antigen target: n/a 
Test method: Automated RT-PCR 
Samples used: Stool, collection not reported 
Transport media: Not stated; coated swabs transferred to 1 ml. 0.85% saline for 
testing 
Sample storage: Stored at 2 to 8C for up to 7 days prior to testing 
Test operator: Not stated 
Definition of test positivity: Describes ‘following the package insert instructions' - 
presumptive positives not reported 
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Szymczak 2020 (continued) 


Target condition and reference standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Blinding reported: Yes; conducted first 


Timing of samples: PCR +ve stool samples collected 0 to 33 days from initial respi- 
ratory PCR; 8/27 collected at >=14 days and 6/27 collected at >=21 days 


Reference standard: RT-PCR; Hologic Panther Fusion 

Definition of non-COVID cases: As for cases (single PCR negative) 
Genetic target(s): two ORF1a regions 

Samples used: Stool, as for index 


Timing of reference standard: Some samples frozen at -800C prior to testing with 
Hologic Panther Fusion 


Blinded to index test: Unclear 


Incorporated index test: No 


Time interval between index and reference tests: Simultaneous; same swabs 
All patients received same reference standard: Yes 

Missing data: None reported, no participant flow diagram reported 
Uninterpretable results: None reported 


Indeterminate results (index test): discrepant results re-tested with both index 
and reference test using both a new aliquot and a shared aliquot tested on both 
instruments on the same day 


Indeterminate results (reference standard): discrepant results re-tested with 
both index and reference test using both a new aliquot and a shared aliquot test- 
ed on both instruments on the same day 


Unit of analysis: Samples (79 from 77 patients) 


Funding: No funding statement reported 
Publication status: Published 
Source: J Clin Microbiol 


Author COI: No COI statement reported 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
Was a consecutive or random sample of patients No 
enrolled? 
Was a case-control design avoided? Unclear 
Did the study avoid inappropriate exclusions? Unclear 
Did the study avoid inappropriate inclusions? Yes 
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Szymczak 2020 (continued) 


Could the selection of patients have intro- 
duced bias? 


Are there concerns that the included patients 
and setting do not match the review ques- 
tion? 

DOMAIN 2: Index Test (Antigen tests) 

DOMAIN 2: Index Test (Rapid molecular tests) 
Were the index test results interpreted without 
knowledge of the results of the reference stan- 
dard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the in- 
dex test have introduced bias? 


Are there concerns that the index test, its con- 
duct, or interpretation differ from the review 
question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly 
classify the target condition? 


Were the reference standard results interpret- 
ed without knowledge of the results of the index 
tests? 


Reference standard does not incorporate result 
of index test? 


Could the reference standard, its conduct, or 
its interpretation have introduced bias? 


Are there concerns that the target condition 
as defined by the reference standard does not 
match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between index 
test and reference standard? 


Did all patients receive the same reference stan- 
dard? 


Were all patients included in the analysis? 


Did all participants receive a reference stan- 
dard? 


Were results presented per patient? 


High risk 


Yes 


Yes 


Low risk 


No 


Unclear 


Yes 


High risk 


Yes 


Yes 


Unclear 


Yes 


No 


High 


High 


High 
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Szymczak 2020 (continued) 


Could the patient flow have introduced bias? 


Takeda 2020 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


Index tests 


Target condition and reference standard(s) 


Unclear risk 


Two group study to estimate sensitivity and specificity, in: 

[1] RT-PCR confirmed COVID-19 samples selected from a total of 88 positive samples 
during time period (n=62); 

[2] Random sample of RT-PCR negative samples selected from 1363 negative speci- 
mens tested during same time frame (n=100) 


Recruitment: Unclear for cases (may have been all 'initial' samples tested); random 
sample of non-cases 


Prospective or retrospective: Unclear 


Setting: Not stated; multiple clinical institutions 
Location: SRL Inc, Tokyo 

Country: Japan 

Dates: early April" also later states 4 day period 
Symptoms and severity: Not stated; 

High viral load (< 25 Ct) - 32/60, 53% 

Low viral load (>=25 Ct) - 28/60, 47% 


Demographics: Not stated 


Exposure history: Not stated 


Test name: ESPLINE SARS-CoV-2 (no product code reported) 

Manufacturer: Fujirebio Inc 

Antibody: SARS-CoV-2 antigen (from IFU) 

Antigen target: Anti-SARS-CoV-2 monoclonal antibodies (mouse) (from IFU) 
Test method: LFA using alkaline phosphatase (ALP) labelled antibodies 
Samples used: NP; collection not reported 

Transport media: Not described 

Sample storage: Swabs mixed with sample treatment solution; no storage reported 
Test operator: Not stated; laboratory staff presumed 

Definition of test positivity: Visual line, as per manufacturer 

Blinding reported: Not stated 


Timing of samples: Not stated but all cases are first samples presumed by authors to 
be from patient suspected of SARS-CoV-2 for the first time; negative samples were 
‘probably ... from ... COVID-19 patients for monitoring purposes and to check for 
negative conversion’ 


Reference standard: RT-PCR; QuantiTect Probe RT-PCR Kit (Qiagen). 
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Takeda 2020 (Continued) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Definition of non-COVID cases: As for cases; single negative required 
Genetic target(s): N2 

Samples used: NP, as for index test 

Timing of reference standard: Not stated 

Blinded to index test: Not stated 


Incorporated index test: No 


Time interval between index and reference tests: Simultaneous, same samples 
All patients received same reference standard: Yes 


Missing data: 16 positive samples omitted; possibly because not initial samples but 
unclearly reported 


Uninterpretable results: None reported 
Indeterminate results (index test): None reported 
Indeterminate results (reference standard): None reported 


Unit of analysis: Patients (for cases), not clear for non-cases 


Funding: None reported, however laboratory wholly owned by test manufacturer 
Publication status: Pre-print 
Source: medRxiv 


Author COI: SRL Inc. is a subsidiary of Miraca Holdings Inc. Miraca Holdings Inc. 
holds all stock of Fujirebio Inc. 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
Was a consecutive or random sample of pa- Yes 
tients enrolled? 
Was a case-control design avoided? Unclear 
Did the study avoid inappropriate exclusions? Unclear 
Did the study avoid inappropriate inclusions? — Unclear 
Could the selection of patients have intro- Unclear risk 
duced bias? 
Are there concerns that the included pa- Unclear 
tients and setting do not match the review 
question? 
DOMAIN 2: Index Test (Antigen tests) 
Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 274 


Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 


Collaboration. 


Trusted evidence. 
Informed decisions. 
Better health. 


+‘ Cochrane 
tw Library 


Cochrane Database of Systematic Reviews 





Takeda 2020 (Continued) 


Were the index test results interpreted with- 
out knowledge of the results of the reference 
standard? 


If a threshold was used, was it pre-specified? 


Could the conduct or interpretation of the 
index test have introduced bias? 


Are there concerns that the index test, its 
conduct, or interpretation differ from the 
review question? 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly 
classify the target condition? 


Were the reference standard results interpret- 
ed without knowledge of the results of the in- 
dex tests? 


Reference standard does not incorporate re- 
sult of index test? 


Could the reference standard, its conduct, 
or its interpretation have introduced bias? 


Are there concerns that the target condi- 
tion as defined by the reference standard 
does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between in- 
dex test and reference standard? 


Did all patients receive the same reference 
standard? 


Were all patients included in the analysis? 


Did all participants receive a reference stan- 
dard? 


Were results presented per patient? 


Could the patient flow have introduced 
bias? 


Thwe 2020 


Study characteristics 


Unclear 


Yes 


Unclear risk 


No 


Unclear 


Yes 


High risk 


Yes 


Yes 


No 


Yes 


Yes 


High risk 


Unclear 


High 
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Thwe 2020 (continued) 


Patient Sampling 


Patient characteristics and setting 


Index tests 


Target condition and reference standard(s) 


Single group study to estimate sensitivity and specificity: 

symptomatic patients with paired samples tested with both ID NOW (dry NP 
swabs) and a real-time RT-PCR assay (NP swabs in VTM) (n=182) 

[samples with RT-PCR using Xpert Xpress (n=21) were excluded from this review] 


Recruitment: Not stated 


Prospective or retrospective: Retrospective 


Setting: Mixed (inpatient and ED); lab-based study 
Location: University of Texas Medical Branch, Galveston 
Country: USA 

Dates: April to May 2020 ('4 weeks data’) 

Symptoms and severity: Not stated 

Demographics: Not stated 


Exposure history: Not stated 


Test name: ID NOW (no product code) 
Manufacturer: Abbott 

Antibody: Not stated 

Antigen target: n/a 

Test method: Isothermal PCR 

Samples used: dry NP swabs 

Transport media: None 

Sample storage: in plain untreated sterile urine collection tubes 
Test operator: Not stated 

Definition of test positivity: As per manufacturer 
Blinding reported: Yes; conducted first 


Timing of samples: Not stated 


Reference standard: One of 4 RT-PCR assays; 

1. Abbott RealTime SARS-CoV-2 (Abbott Park, IL, USA) (n=22) 

2. Panther Fusion® SARS-COV-2 (San Diego, CA, USA) (n=129) 

3. Cepheid Xpert® Xpress SARS-CoV-2 (Sunnyvale, CA, USA)) (n=21; excluded 
from this review) 

4. a laboratory developed 

test (LDT) (n=10) 


Definition of non-COVID cases: As for cases (single negative) 
Genetic target(s): Not stated 

Samples used: NP in VTM (paired) 

Timing of reference standard: Not stated 


Blinded to index test: Not stated 
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Thwe 2020 (continued) 





Incorporated index test: No 


Flow and timing Time interval between index and reference tests: Paired 
All patients received same reference standard: Yes 


Missing data: None reported (review team excluded 21 samples tested with RT- 
PCR) 


Uninterpretable results: None reported 
Indeterminate results (index test): None reported 


Indeterminate results (reference standard): None reported; no discrepant analy- 
sis 


Unit of analysis: Patient 


Comparative 


Notes Funding: This project did not receive any funding support from any agencies in 
the public, commercial, or not for-profit sectors 


Publication status: Published 
Source: Diagnostic Microbiol Infect Dis 


Author COI: All authors have no conflict of interest. 
Methodological quality 
Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of patients Unclear 
enrolled? 


Was a case-control design avoided? Yes 
Did the study avoid inappropriate exclusions? Unclear 
Did the study avoid inappropriate inclusions? Unclear 


Could the selection of patients have introduced Unclear risk 
bias? 


Are there concerns that the included patients Unclear 
and setting do not match the review question? 


DOMAIN 2: Index Test (Antigen tests) 


DOMAIN 2: Index Test (Rapid molecular tests) 





Were the index test results interpreted without Yes 
knowledge of the results of the reference stan- 
dard? 
If a threshold was used, was it pre-specified? Yes 
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Thwe 2020 (continued) 





Could the conduct or interpretation of the in- Low risk 
dex test have introduced bias? 


Are there concerns that the index test, its con- Unclear 
duct, or interpretation differ from the review 
question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly clas- No 
sify the target condition? 


Were the reference standard results interpret- Unclear 
ed without knowledge of the results of the index 
tests? 


Reference standard does not incorporate result of Yes 
index test? 


Could the reference standard, its conduct, or High risk 
its interpretation have introduced bias? 


Are there concerns that the target condition High 
as defined by the reference standard does not 
match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval betweenindex Yes 
test and reference standard? 


Did all patients receive the same reference stan- Yes 
dard? 
Were all patients included in the analysis? Unclear 


Did all participants receive areference standard? Yes 
Were results presented per patient? Yes 


Could the patient flow have introduced bias? Unclear risk 


Van der Moeren 2020(a) 





Study characteristics 

Patient Sampling Study reports data for two cohorts. Van der Moeren 2020(a) relates to cohort [1] Single 
group study to estimate sensitivity and specificity: all adults presenting at a single com- 
munity test centre for COVID-19 testing (n=354) 
see Van der Moeren 2020(b) for cohort [2] data 
[2] Single group study to estimate sensitivity alone: patients with a positive PCR test re- 
sult at one of 3 community testing facilities who were retested at home within 72h of ini- 
tial positive result (n=132) 
Recruitment: Consecutive; ‘all’ adults invited to participate 
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Van der Moeren 2020(a) (continued) 





Prospective or retrospective: Prospective 


Patient characteristics and setting Setting: COVID-19 test centre (community) 
Location: Municipal Health Service (GGD) regional test centre at Breda 
Country: Netherlands 
Dates: Sep 28 to Sep 30 
Symptoms and severity: Not stated; symptomatic 
Demographics: Not stated 


Exposure history: Not stated 


Index tests Test name: BD Veritor System for Rapid Detection of SARS-CoV-2 
Manufacturer: Becton Dickinson 
Antibody: NP 
Antigen target: Not stated 
Test method: LFA; no further detail 


Samples used: NOP; "specimen from the throat and the superficial nasal cavities (bilat- 
eral, 2.5 cm proximal from the nostril)"; collected by GGD employee 


Transport media: Direct testing 


Sample storage: stored dry in sterile test tubes and stored and transported on dry ice 
until processing at the laboratory; tested within 6 hours after collection 


Test operator: trained laboratory technicians 


Definition of test positivity: reported using Analyzer (included in main analysis for re- 
view), and by naked eye inspection alone 


Blinding reported: Not stated 


Timing of samples: Not reported; on presentation 
time pso only provided for PCR+ cases: 12 < 7d; 1 = 7d; 4=no pso data 


Target condition and reference stan- Reference standard: RT-PCR; either Cobas 6800 (Roche) or the m2000 (Abbott). 
dard(s) 
Definition of non-COVID cases: As for cases; single negative 


Genetic target(s): E- and RDRP-gene (Cobas) or 
E-gene and N-gene (Abbott) 


Samples used: NOP; specimen from the throat and nasal cavity up to the nasal bridge 
Timing of reference standard: As for index test 
Blinded to index test: Not stated 


Incorporated index test: No 


Flow and timing Time interval between index and reference tests: Paired 
All patients received same reference standard: Yes; different assays 


Missing data: 2 samples excluded due to RT-PCR coding error [Considered overall low 
risk of bias due to small numbers] 
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Van der Moeren 2020(a) (Continued) 


Uninterpretable results: 1 invalid on Ag test 


Indeterminate results (index test): None reported 


Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 


Comparative 


Notes Funding: The VRD (antigen) tests for this study were provided by the Dutch Ministry of 


Health, Welfare and Sport (VWS). 


Publication status: Pre-print 
Source: medRxiv 


Author COI: Jan Kluytmans is member of the National Outbreak Management Team of 
The Netherlands and of a committee which supports the implementation of the Coro- 
na-reporting App. 


Methodological quality 


Item Authors' judgement 


DOMAIN 1: Patient Selection 


Was a consecutive or random sample of Yes 
patients enrolled? 


Was a case-control design avoided? Yes 
Did the study avoid inappropriate exclu- Yes 
sions? 
Did the study avoid inappropriate inclu- Yes 
sions? 


Could the selection of patients have in- 
troduced bias? 


Are there concerns that the included 
patients and setting do not match the 
review question? 


DOMAIN 2: Index Test (Antigen tests) 
Were the index test results interpreted Unclear 
without knowledge of the results of the 


reference standard? 


If a threshold was used, was it pre-speci- Yes 
fied? 


Could the conduct or interpretation of 
the index test have introduced bias? 


Risk of bias Applicability concerns 
Low risk 

Low concern 
Unclear risk 
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Van der Moeren 2020(a) (continued) 


Are there concerns that the index test, 
its conduct, or interpretation differ 
from the review question? 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to cor- 
rectly classify the target condition? 


Were the reference standard results inter- 
preted without knowledge of the results 


of the index tests? 


Reference standard does not incorporate 
result of index test? 


Could the reference standard, its con- 
duct, or its interpretation have intro- 
duced bias? 


Are there concerns that the target con- 
dition as defined by the reference stan- 
dard does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval be- 
tween index test and reference standard? 


Did all patients receive the same refer- 
ence standard? 


Were all patients included in the analysis? 


Did all participants receive a reference 
standard? 


Were results presented per patient? 


Could the patient flow have introduced 
bias? 


Van der Moeren 2020(b) 


Study characteristics 


Patient Sampling 


No 


Unclear 


Yes 


High risk 


Yes 


Yes 


No 


Yes 


Yes 


Low risk 


Study reports data for two cohorts. Van der Moeren 2020(b) relates to cohort 


High 


High 


[2] Single group study to estimate sensitivity alone: patients with a positive PCR test re- 
sult at one of twp community testing facilities who were retested at home within 72h of 


initial positive result (n=132) 


see Van der Moeren 2020(a) for data related to cohort [1] Single group study to estimate 


sensitivity and specificity: all adults presenting at a single community test centre for 


COVID-19 testing (n=354) 
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Van der Moeren 2020(b) (continued) 





Recruitment: Unclear; implies 'all' those with positive PCR invited to participate 


Prospective or retrospective: Prospective 


Patient characteristics and setting Setting: Community 
Location: Municipal Health Service (GGD) regional test centres at Breda or Roosendaal 
Country: Netherlands 
Dates: Sep 28 to Oct 6 
Symptoms and severity: At time of home visit: 
Asymptomatic 3, 2% (2/3 still PCR +ve) 
Symptomatic 129 (123 still PCR +ve) 
Day <7 66, 50% 
Day >7 57, 43% 
Demographics: Not stated 


Exposure history: Not stated 


Index tests Test name: BD Veritor System for Rapid Detection of SARS-CoV-2 
Manufacturer: Becton Dickinson 
Antibody: NP 
Antigen target: Not stated 
Test method: LFA; no further detail 


Samples used: NOP? "specimen from the throat and the superficial nasal cavities (bilat- 
eral, 2.5 cm proximal from the nostril)"; collected by GGD employee 


Transport media: Direct testing 


Sample storage: stored dry in sterile test tubes and stored and transported on dry ice 
until processing at the laboratory; tested within 6 hours after collection 


Test operator: trained laboratory technicians 


Definition of test positivity: reported using Analyzer (included in main analysis for re- 
view), and by naked eye inspection alone 


Blinding reported: Not stated 


Timing of samples: Not reported; on presentation 


Target condition and reference stan- Reference standard: RT-PCR; either Cobas 6800 (Roche) or the m2000 (Abbott). 
dard(s) 
Definition of non-COVID cases: n/a 


Genetic target(s): E- and RDRP-gene (Roche) or 
E-gene and N-gene (Abbott) 


Samples used: NOP; specimen from the throat and nasal cavity up to the nasal bridge 
Timing of reference standard: As for index test 
Blinded to index test: Not stated 


Incorporated index test: No 


Flow and timing Time interval between index and reference tests: Paired 
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Van der Moeren 2020(b) (continued) 


Comparative 


Notes 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of 
patients enrolled? 


Was a case-control design avoided? 


Did the study avoid inappropriate exclu- 
sions? 


Did the study avoid inappropriate inclu- 
sions? 


Could the selection of patients have in- 
troduced bias? 


Are there concerns that the included 
patients and setting do not match the 
review question? 


DOMAIN 2: Index Test (Antigen tests) 
Were the index test results interpreted 
without knowledge of the results of the 


reference standard? 


If a threshold was used, was it pre-speci- 
fied? 


All patients received same reference standard: Yes; different assays 


Missing data: Review team excluded 7 no longer PCR+ at time of home visit (1 asympto- 
matic, 6 symptomatic) - VRD result for 1 asymptomatic PCR- is given (VRD-) 


Uninterpretable results: None reported 
Indeterminate results (index test): None reported 
Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 


Funding: The VRD (antigen) tests for this study were provided by the Dutch Ministry of 
Health, Welfare and Sport (VWS). 


Publication status: Pre-print 
Source: medRxiv 


Author COI: Jan Kluytmans is member of the National Outbreak Management Team of 
The Netherlands and of a committee which supports the implementation of the Coro- 
na-reporting App. 


Authors' judgement Risk of bias Applicability concerns 


Unclear 


No 


Yes 


Yes 


High risk 


High 


Unclear 


Yes 
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Van der Moeren 2020(b) (Continued) 


Could the conduct or interpretation of 
the index test have introduced bias? 


Are there concerns that the index test, 
its conduct, or interpretation differ 
from the review question? 


Unclear risk 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to cor- 
rectly classify the target condition? 


Were the reference standard results inter- 
preted without knowledge of the results 


of the index tests? 


Reference standard does not incorporate 
result of index test? 


Could the reference standard, its con- 
duct, or its interpretation have intro- 
duced bias? 


Are there concerns that the target con- 
dition as defined by the reference stan- 
dard does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval be- 
tween index test and reference standard? 


Did all patients receive the same refer- 
ence standard? 


Were all patients included in the analysis? 


Did all participants receive a reference 
standard? 


Were results presented per patient? 


Could the patient flow have introduced 
bias? 


Veyrenche 2020 


Study characteristics 


Patient Sampling 


No 


Unclear 


Yes 


High risk 


Yes 


Yes 


No 


Yes 


Yes 


High risk 


High 


High 


Two group study estimating sensitivity and specificity: 


[1] PCR+ hospital inpatients (n=45) 


[2] pre-pandemic samples from 'patients' (not otherwise specified) (n=20) 
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Veyrenche 2020 (continued) 


Patient characteristics and setting 


Index tests 


Target condition and reference standard(s) 


Recruitment: Not stated; appears to be convenience as equal numbers per Ct value 
subgroup 


Prospective or retrospective: Retrospective 


Setting: Inpatient 


Location: Montpellier University hospitals (Centre Hospitalier Universitaire de 
Montpellier, Montpellier) 


Country: France 
Dates: 14 March to 11 April 


Symptoms and severity: 27/45, 60% cases 'severe' according to WHO guideline 
(similar numbers per Ct subgroup) 


Demographics: Median age: 

Ct<=25 - 66 (IQR 48, 84) 

Ct 25-35 - 63 (50, 76) 

Ct>=35 - 58 (49-67) 

Controls 64 (35, 93); 

32/45, 71% male, all controls were male 


Exposure history: Not stated 


Test name: Coris COVID-19 Ag Respi-Strip 
Manufacturer: BioConcept®, Gembloux, Belgium 
Antibody: NP 

Antigen target: monoclonal ab 

Test method: CGIA 

Samples used: NP; collection not described 


Transport media: Yes; "swabs were collected in various transport media (eSwab™ 
COPAN Amies 1 ml, 2-Transwab® liquid Amies, viral transport medium tube VTM-M 
2.0ml)." 


Sample storage: Unclear; RT-PCR conducted prospectively within a few hours but 
not reported for Ag testing 


Test operator: Not stated; presume lab staff 
Definition of test positivity: Visual, as per manufacturer 
Blinding reported: Not stated 


Timing of samples: day 1 to 20 pso, median 

Ct<=25 - 7 (4, 10; presume this is IQR but could be range - is described as SD in pa- 
per) 

Ct 25-35 - 8 (4, 12) 

Ct>=35 - 11 (7, 15) 


Reference standard: RT-PCR; Allplex™ 2019-nCoV Assay (Seegene, Seoul, South Ko- 
rea) 


Definition of non-COVID cases: pre-pandemic 
Genetic target(s): RdRp, N, E 


Samples used: NP; as for index 
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Veyrenche 2020 (continued) 


Flow and timing 


Timing of reference standard: As for index 
Blinded to index test: Yes, conducted first 


Incorporated index test: No 


Time interval between index and reference tests: Simultaneous; same swab 


Comparative 


Notes 


All patients received same reference standard: No 

Missing data: None reported, no participant flow diagram reported 
Uninterpretable results: None reported 

Indeterminate results (index test): None reported 

Indeterminate results (reference standard): None reported 


Unit of analysis: Patients 


Funding: supported by Grants from Montpellier University Hospital and Montpelli- 


er University (MUSE). 
Publication status: pre-print 
Source: medRxiv 


Author COI: The authors declare that there are no conflicts of interest 


Methodological quality 


Authors' judgement 





Item Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
Was a consecutive or random sample of pa- No 
tients enrolled? 
Was a case-control design avoided? No 
Did the study avoid inappropriate exclusions? Unclear 
Did the study avoid inappropriate inclusions? Unclear 
Could the selection of patients have intro- High risk 
duced bias? 
Are there concerns that the included pa- High 
tients and setting do not match the review 
question? 
DOMAIN 2: Index Test (Antigen tests) 
Were the index test results interpreted without — Unclear 
knowledge of the results of the reference stan- 
dard? 
If a threshold was used, was it pre-specified? Yes 
Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 286 


Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 


Collaboration. 


| Coch rane Trusted evidence. 
= Lib Informed decisions. 
| iprary Better health. Cochrane Database of Systematic Reviews 


Veyrenche 2020 (continued) 





Could the conduct or interpretation of the Unclear risk 
index test have introduced bias? 


Are there concerns that the index test, its Unclear 
conduct, or interpretation differ from the re- 

view question? 

DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to correctly Yes 
classify the target condition? 


Were the reference standard results interpret- Yes 
ed without knowledge of the results of the in- 
dex tests? 


Reference standard does not incorporate result Yes 
of index test? 


Could the reference standard, its conduct, or Low risk 
its interpretation have introduced bias? 


Are there concerns that the target condition High 
as defined by the reference standard does 
not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval between in- Yes 
dex test and reference standard? 


Did all patients receive the same reference No 

standard? 

Were all patients included in the analysis? Unclear 

Did all participants receive a reference stan- Yes 

dard? 

Were results presented per patient? Yes 

Could the patient flow have introduced bias? High risk 


Weitzel 2020 [A] 





Study characteristics 
Patient Sampling Single-group study to estimate sensitivity and specificity: 
- samples from patients with respiratory symptoms and/or fever attending a private hospital 
ED 
Recruitment: convenience with deliberate sampling of positive cases to ensure a 2:1 distribu- 
tion reported (5276 samples processed during study period) 
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Weitzel 2020 [A] (continued) 


Patient characteristics and setting 


Prospective or retrospective: retrospective 
Number of samples (samples with confirmed SARS-CoV-2): 111 (80) 


*17 samples included in Porte 2020a 


Setting: ED (private hospital) 

Location: Clinica Alemana de Santiago 

Country: Chile 

Dates: 16 March-26 April 2020 

Symptoms and severity: respiratory symptoms and/or fever; no further detail 


Demographics: median age 40 years; 50, 45% male (median age 38 years, 43% male for all sam- 
ples tested during period) 


Exposure history: none reported 





Index tests Weitzel 2020 [A] entry is for test [A] in the list below 

Test name: 
[A] Biocredit COVID-19 Ag One Step SARS-CoV-2 Antigen Test (RapiGEN Inc., Anyang-si, 
Gyeonggi-do, Republic of Korea) 
[B] COVID-19 Antigen Rapid Test Device StrongStep COVID-19 Antigen Test (Liming Bio-Prod- 
ucts Co., Jiangsu, China) 
[C] Huaketai New Coronavirus (SARS-CoV-2) N Protein Detection Kit (Fluorescence im- 
munochromatography) (Savant Biotechnology Co., Beijing, China), 
[D] Diagnostic Kit for 2019-Novel Coronavirus (2019-nCoV) Ag Test (Fluorescence Immunochro- 
matographic Assay) (Bioeasy Biotechnology Co., Shenzhen, China). 
Manufacturer: 
[A] RapiGEN Inc., Anyang-si, Gyeonggi-do, Republic of Korea 
[B] Liming Bio-Products Co., Jiangsu, China 
[C] Savant Biotechnology Co., Beijing, China 
[D] Bioeasy Biotechnology Co., Shenzhen, China 
Antigen target: not reported in study 
Antibody: not reported in study 
Test method: [A] and [B] CGIA 
[C] and [D] FIA 
Samples used: NOP swabs in 3 mL UTM 
Transport media: UTM-RT System (Copan Diagnostics, Murrieta, CA, USA) 
Sample storage: stored at -80 °C; index tests applied on 28 and 29 April 2020 
Test operator: single, trained laboratory technician under BSL2 cabinet; visual outputs read by 
2 independent observers with referral to third if needed 
Definition of test positivity: as per manufacturer; Beijing Savant test required use of manufac- 
turer supplied UV torch due to unavailability of reader device in Chile 
Blinding reported: yes; blinding stated 
Timing of samples: median 2 days (IQR 1-5 days); 88% (96/109) during the first week of symp- 
toms 
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Weitzel 2020 [A] (continued) 


Target condition and reference 
standard(s) 


Flow and timing 


Comparative 


Notes 


Methodological quality 


Reference standard: RT-PCR; COVID-19 Genesig Real-Time PCR assay (Primerdesign Ltd., Chan- 
dler's Ford, UK). Ct < 40 considered positive 


Definition of non-COVID cases: single PCR negative 

Genetic target(s): RdRp 

Samples used: NOP swabs; as for index 

Timing of reference standard: as for index test; median 2 days (IQR 1-5 days) 
Blinded to index test: yes; prior to index 


Incorporated index test: no 


Time interval between index and reference tests: same samples; index tests conducted after 
frozen storage 


All participants received same reference standard: yes 


Missing data: none reported; evaluation of Liming test was discontinued after initial poor per- 
formance (zero TP) 


Uninterpretable results: 2 tests had invalid results due to insufficient liquid migration (2 results 
excluded for each test) 


Indeterminate results (index test): visual interpretation of the Beijing Savant assay (using man- 
ufacturer supplied UV torch) was reportedly difficult under daylight conditions; manufacturer's 
fluorescence reader not available in Chile. 


Indeterminate results (reference standard): none reported 


Unit of analysis: participants 


Funding: study authors report that the work received no funding; Savant Biotechnology Co. 
provided test kits free of charge 


Publication status: preprint 
Source: medRxiv 


Author COI: all authors declare no competing interests 





Item Authors' judgement Risk of bias Applicability concerns 
DOMAIN 1: Patient Selection 
Was a consecutive orrandomsam- No 
ple of patients enrolled? 
Was a case-control design avoid- No 
ed? 
Did the study avoid inappropriate Unclear 
exclusions? 
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Weitzel 2020 [A] (continued) 


Did the study avoid inappropriate Yes 
inclusions? 


Could the selection of patients 
have introduced bias? 


Are there concerns that the in- 
cluded patients and setting do 
not match the review question? 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test results inter- Yes 
preted without knowledge of the 
results of the reference standard? 


If a threshold was used, wasit pre- Yes 
specified? 


Could the conduct or interpreta- 
tion of the index test have intro- 
duced bias? 


Are there concerns that the in- 
dex test, its conduct, or inter- 
pretation differ from the review 
question? 


DOMAIN 2: Index Test (Rapid molecular tests) 


DOMAIN 3: Reference Standard 


Is the reference standards likely to No 
correctly classify the target condi- 
tion? 


Were the reference standard re- Yes 
sults interpreted without knowl- 

edge of the results of the index 

tests? 


Reference standard does not in- Yes 
corporate result of index test? 


Could the reference standard, 
its conduct, or its interpretation 
have introduced bias? 


Are there concerns that the tar- 
get condition as defined by the 
reference standard does not 
match the question? 


DOMAIN 4: Flow and Timing 
Was there an appropriate interval Yes 


between index test and reference 
standard? 


High risk 


Low risk 


High risk 


High 


High 


High 
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Weitzel 2020 [A] (continued) 


Did all patients receive the same Yes 


reference standard? 


Were all patients included in the No 


analysis? 


Did all participants receive arefer- Yes 


ence standard? 


Were results presented per pa- Yes 


tient? 


Could the patient flow have in- High risk 


troduced bias? 


Weitzel 2020 [B] 


Study characteristics 
Patient Sampling 


Patient characteris- 
tics and setting 


Index tests 


See Weitzel 2020 [A] for full study details and QUADAS entries 


Weitzel 2020 [B] entry is for test [B] in the list below; see Weitzel 2020 [A] for full study details and QUADAS en- 
tries 


Test name: 


[A] Biocredit COVID-19 Ag One Step SARS-CoV-2 Antigen Test (RapiGEN Inc., Anyang-si, Gyeonggi-do, Republic 
of Korea) 

[B] COVID-19 Antigen Rapid Test Device StrongStep COVID-19 Antigen Test (Liming Bio-Products Co., 
Jiangsu, China) 

[C] Huaketai New Coronavirus (SARS-CoV-2) N Protein Detection Kit (Fluorescence immunochromatography) 
(Savant Biotechnology Co., Beijing, China), 

[D] Diagnostic Kit for 2019-Novel Coronavirus (2019-nCoV) Ag Test (Fluorescence Immunochromatographic As- 
say) (Bioeasy Biotechnology Co., Shenzhen, China). 


Manufacturer: 

[A] RapiGEN Inc., Anyang-si, Gyeonggi-do, Republic of Korea 
[B] Liming Bio-Products Co., Jiangsu, China 

[C] Savant Biotechnology Co., Beijing, China 

[D] Bioeasy Biotechnology Co., Shenzhen, China 

Antigen target: not reported in study 

Antibody: not reported in study 


Test method: [A] and [B] CGIA 
[C] and [D] FIA 


Samples used: NOP swabs in 3 mL UTM 
Transport media: UTM-RT System (Copan Diagnostics, Murrieta, CA, USA) 


Sample storage: stored at -80 °C; index tests applied on 28 and 29 April 2020 
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Weitzel 2020 [B] (continued) 
Test operator: single, trained laboratory technician under BSL2 cabinet; visual outputs read by 2 independent 
observers with referral to third if needed 





Definition of test positivity: as per manufacturer; Savant test required use of manufacturer supplied UV torch 
due to unavailability of reader device in Chile 


Blinding reported: yes; blinding stated 


Timing of samples: median 2 days (IQR 1-5 days); 88% (96/109) during the first week of symptoms 


Target condition See Weitzel 2020 [A] for full study details and QUADAS entries 
and reference stan- 

dard(s) 

Flow and timing See Weitzel 2020 [A] for full study details and QUADAS entries 


Comparative 


Notes 


Weitzel 2020 [C] 


Study characteristics 
Patient Sampling See Weitzel 2020 [A] for full study details and QUADAS entries 


Patient characteris- | See Weitzel 2020 [A] for full study details and QUADAS entries 
tics and setting 


Index tests Weitzel 2020 [C] entry is for test [C] in the list below; see Weitzel 2020 [A] for full study details and QUADAS en- 
tries 


Test name: 


[A] Biocredit COVID-19 Ag One Step SARS-CoV-2 Antigen Test (RapiGEN Inc., Anyang-si, Gyeonggi-do, Republic 
of Korea) 

[B] COVID-19 Antigen Rapid Test Device StrongStep COVID-19 Antigen Test (Liming Bio-Products Co., Jiangsu, 
China) 

[C] Huaketai New Coronavirus (SARS-CoV-2) N Protein Detection Kit (Fluorescence immunochromatog- 
raphy) (Savant Biotechnology Co., Beijing, China), 

[D] Diagnostic Kit for 2019-Novel Coronavirus (2019-nCoV) Ag Test (Fluorescence Immunochromatographic As- 
say) (Bioeasy Biotechnology Co., Shenzhen, China). 


Manufacturer: 

[A] RapiGEN Inc., Anyang-si, Gyeonggi-do, Republic of Korea 
[B] Liming Bio-Products Co., Jiangsu, China 

[C] Savant Biotechnology Co., Beijing, China 

[D] Bioeasy Biotechnology Co., Shenzhen, China 

Antigen target: not reported in study 

Antibody: not reported in study 


Test method: [A] and [B] CGIA 
[C] and [D] FIA 


Samples used: NOP swabs in 3 mL UTM 


Transport media: UTM-RT System (Copan Diagnostics, Murrieta, CA, USA) 
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Weitzel 2020 [C] (continued) 
Sample storage: stored at -80 °C; index tests applied on 28 and 29 April 2020 





Test operator: single, trained laboratory technician under BSL2 cabinet; visual outputs read by 2 independent 
observers with referral to third if needed 


Definition of test positivity: as per manufacturer; Savant test required use of manufacturer supplied UV torch 
due to unavailability of reader device in Chile 


Blinding reported: yes; blinding stated 


Timing of samples: median 2 days (IQR 1-5 days); 88% (96/109) during the first week of symptoms 


Target condition See Weitzel 2020 [A] for full study details and QUADAS entries 
and reference stan- 

dard(s) 

Flow and timing See Weitzel 2020 [A] for full study details and QUADAS entries 


Comparative 


Notes 


Weitzel 2020 [D] 


Study characteristics 
Patient Sampling See Weitzel 2020 [A] for full study details and QUADAS entries 


Patient characteris- | See Weitzel 2020 [A] for full study details and QUADAS entries 
tics and setting 


Index tests Weitzel 2020 [D] entry is for test [D] in the list below; see Weitzel 2020 [A] for full study details and QUADAS en- 
tries 


Test name: 


[A] Biocredit COVID-19 Ag One Step SARS-CoV-2 Antigen Test (RapiGEN Inc., Anyang-si, Gyeonggi-do, Republic 
of Korea) 

[B] COVID-19 Antigen Rapid Test Device StrongStep® COVID-19 Antigen Test (Liming Bio-Products Co., Jiangsu, 
China) 

[C] Huaketai New Coronavirus (SARS-CoV-2) N Protein Detection Kit (Fluorescence immunochromatography) 
(Savant Biotechnology Co., Beijing, China), 

[D] Diagnostic Kit for 2019-Novel Coronavirus (2019-nCoV) Ag Test (Fluorescence Immunochromato- 
graphic Assay) (Bioeasy Biotechnology Co., Shenzhen, China). 


Manufacturer: 

[A] RapiGEN Inc., Anyang-si, Gyeonggi-do, Republic of Korea 
[B] Liming Bio-Products Co., Jiangsu, China 

[C] Savant Biotechnology Co., Beijing, China 

[D] Bioeasy Biotechnology Co., Shenzhen, China 

Antigen target: not reported in study 

Antibody: not reported in study 


Test method: [A] and [B] CGIA 
[C] and [D] FIA 


Samples used: NOP swabs in 3 mL UTM 
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Weitzel 2020 [D] (continued) 


Transport media: UTM-RT System (Copan Diagnostics, Murrieta, CA, USA) 


Sample storage: stored at -80°C; index tests applied on 28 and 29 April 2020 


Test operator: single, trained laboratory technician under BSL2 cabinet; visual outputs read by 2 independent 
observers with referral to third if needed 


Definition of test positivity: as per manufacturer; Savant test required use of manufacturer supplied UV torch 
due to unavailability of reader device in Chile 


Blinding reported: yes; blinding stated 


Timing of samples: median 2 days (IQR 1-5 days); 88% (96/109) during the first week of symptoms 


Target condition See Weitzel 2020 [A] for full study details and QUADAS entries 
and reference stan- 

dard(s) 

Flow and timing See Weitzel 2020 [A] for full study details and QUADAS entries 


Comparative 


Notes 


Wolters 2020 


Study characteristics 


Patient Sampling 


Patient characteristics and set- 
ting 


2-group study to estimate sensitivity and specificity for diagnosis of active disease: 

- samples selected from laboratories on the basis of presence/absence of 2 genetic targets on 
RT-PCR: SARS-CoV-2 E-gene +/RdRp gene + (n = 30); SARS-CoV-2 E-gene +/RdRp gene - (n = 28); 
SARS-CoV-2 E-gene -/RdRp gene (n = 30) 

(A separate set of samples were tested in triplicate at all 3 laboratories to determine limits of de- 
tection and analytical specificity) 

Recruitment: not stated; deliberate sampling used 

Prospective or retrospective: retrospective 


Sample size (cases): 88 (58) 


Setting: not stated; 3 laboratories 

Location: Radboud UMC in Nijmegen, PAMM in Veldhoven and the RIVM in Bilthoven 
Country: The Netherlands 

Dates: January-March 2020 

Symptoms and severity: not stated 

Demographics: not stated 


Exposure history: not stated 





Index tests Test name: Cepheid Xpert Xpress SARS-CoV-2 (product code not reported) 
Manufacturer: Cepheid Europe 
Antigen target: E-gene (sarbeco-specific) and N2-gene (SARS-CoV-2-specific) 
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Wolters 2020 (continued) 


Target condition and reference 
standard(s) 


Flow and timing 


Antibody: N/A 

Test method: not stated (it should be automated PCR) 
Samples used: NP or mid-turbinate, and OP swabs 
Transport media: UTM or GLY medium; no further details 
Sample storage: stored at -80 

Test operator: not stated; presume laboratory staff 


Definition of test positivity: as per manufacturer; reported E-gene-only positive specimens as 
presumptive positive but no re-testing with Xpert Xpress was reported. N2-only positives were 
considered positive (but re-tested with RT-PCR) 


Blinding reported: not stated (see comment section) 


Timing of samples: not stated 


Reference standard: in-house RT-PCR: 

Radboud UMC Lab: MagNApure 96 (Roche) (isolation platform); MagNApure 96 DNA and Viral 

NA Small Volume (extraction kit); Roche LC480 II (PCR platform); Life Technologies Taqman 
FastVirus 1-step mastermix (RT-PCR mastermix) 

PAMM Lab: Roche cobas 4800 (isolation platform); CT/NG extraction protocol (extraction kit); 
Roche LC480 II (PCR platform); Roche LightCycler Multiplex RNA Virus Master (RT-PCR master- 
mix); 

RIVM Lab: BioMérieux NucliSens (isolation platform); easyMAG EasyMAG extraction reagents (ex- 
traction kit); Thermo Fisher QuantStudio 6 (PCR platform); Life Technologies Taqman FastVirus 
1-step mastermix (RT-PCR mastermix) 


Definition of non-COVID cases: yes (performed prior to index test) 


Genetic target(s): Radboud UMC lab: E-gene and RdRp-gene 

PAMM Lab: started with E-gene and RdRp-gene and mid-March moved on to E-gene testing only 
RIVM Lab: started with E-gene and RdRp-gene and at the beginning of April moved on to E-gene 
and CDC N1-gene primer and probes 


Samples used: as for index test 
Timing of reference standard: as for index test 


Blinded to index test: storage prior to freezing was not reported; samples were analysed at or 
near time of collection ("processed ... in the routine diagnostic procedure using the locally im- 
plemented RT-PCR") 


Incorporated index test: no 


Time interval between index and reference tests: same samples used; index text seems to have 
been conducted after frozen storage 


Missing data: none reported, no participant flow diagram reported 
Uninterpretable results: none reported 


Indeterminate results (index test): 1 sample was positive only on N2 gene (positive according to 
IFU) and 1 was positive only on E gene (presumptive positive, requires re-testing according to 
IFU). Both samples were re-tested on RT-PCR only 


Indeterminate results (reference standard): re-testing of the two ‘FN’ samples (one TP and 1 
presumptive positive according to IFU definition) with RT-PCR found both samples to be dis- 
ease-negative (reclassed as 1 TN and 1 FP); study authors note that the viral loads of these sam- 
ples are at the limit of detection for Xpert Xpress and that multiple freeze-thaw steps of samples 
could have had a significant impact on detection. 
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Wolters 2020 (continued) 


Comparative 


Notes 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random 
sample of patients enrolled? 


Was a case-control design avoid- 
ed? 


Did the study avoid inappropriate 
exclusions? 


Did the study avoid inappropriate 
inclusions? 


Could the selection of patients 
have introduced bias? 


Are there concerns that the in- 
cluded patients and setting do 
not match the review question? 


Unit of analysis: not stated; only samples reported 


Funding: not stated 
Publication status: accepted manuscript 
Source: Journal of Clinical Virology 


Author COI: the study authors declare no COI present 


Authors' judgement Risk of bias 
No 
No 
Unclear 
Unclear 
High risk 


DOMAIN 2: Index Test (Antigen tests) 


DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test results inter- 
preted without knowledge of the 
results of the reference standard? 


If a threshold was used, was it 
pre-specified? 


Could the conduct or interpre- 
tation of the index test have in- 
troduced bias? 


Are there concerns that the in- 
dex test, its conduct, or inter- 
pretation differ from the re- 
view question? 


DOMAIN 3: Reference Standard 


Unclear 


No 


High risk 


Applicability concerns 


High 


High 
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Wolters 2020 (continued) 


Is the reference standards like- 
ly to correctly classify the target 
condition? 


Were the reference standard re- 
sults interpreted without knowl- 
edge of the results of the index 
tests? 


Reference standard does not in- 
corporate result of index test? 


Could the reference standard, 
its conduct, or its interpreta- 
tion have introduced bias? 


Are there concerns that the tar- 
get condition as defined by the 
reference standard does not 
match the question? 


DOMAIN 4: Flow and Timing 
Was there an appropriate interval 
between index test and reference 


standard? 


Did all patients receive the same 
reference standard? 


Were all patients included in the 
analysis? 


Did all participants receive a ref- 
erence standard? 


Were results presented per pa- 
tient? 


Could the patient flow have in- 
troduced bias? 


Wong 2020 


Study characteristics 


Patient Sampling 


Patient characteristics and setting 


No 


Yes 


Yes 


High risk 


High 


Yes 


Yes 


Unclear 


Yes 


Unclear 


Unclear risk 


Single group study to estimate sensitivity and specificity: 

- samples submitted for routine testing from patients with suspected COVID-19 infection 
presenting at A&E (n=93), in-patient (n=47) or outpatient n=18) (total n=158 providing 
162 samples) 

Recruitment: Not stated 


Prospective or retrospective: Both retrospective (n=74) and prospective (n=88) 


Setting: Mixed; A&E, inpatient and outpatient 
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Wong 2020 (Continued) 





Location: Prince of Wales Hospital, Hong Kong 

Country: China 

Dates: Not stated 

Symptoms and severity: Not stated 

Demographics: Median age 46 (IQR: 35(28-63); males = 69 (44%) 


Exposure history: Not stated 


Index tests Test name: Xpert Xpress 
Manufacturer: Cepheid Inc 
Antibody: E and N2 
Antigen target: n/.a 
Test method: Automated RT-PCR 


Samples used: deep throat saliva (DTS) (n=120), or lower respiratory tract (LRT) (n=42; 
35 sputum, 6 tracheal aspirate 1 BAL) 


Transport media: None; collected in plain sterile container. 

Prior to testing, PBS was added to was added into neat DTS specimens (ratio 1:1) and 
vortexed for homogenization and allowed to settle for 5- 10 min. 2mL of homogenized 
sample transferred to another vial for centrifugation at 2000 g for 5 min. mL of LRT 
specimens added to 3 mL of in-house prepared Maintenance Medium (MM) (10X Mini- 
mum Essential Medium (MEM), 200 mM glutamine, 1 M HEPES, 7.5 % NaHCO3, 12 mg 
gentamicin, 0.5 mg amphotericin B, 10,000 units penicillin, 10 mg streptomycin, pH 7.1- 
7.4); mixture was emulsified by pipetting up and down, followed by centrifugation at 
2000 g for 5 min. Supernatant was used for testing as per manufacturer’s instructions for 
both RT-PCR and Xpert Xpress 


Sample storage: transported to laboratory on the same day and tested promptly 
Test operator: Lab staff 


Definition of test positivity: As per manufacturer; presumptive positives mentioned only 
in Introduction section 


Blinding reported: Not stated 


Timing of samples: Not stated 


Target condition and reference stan- Reference standard: RT-PCR; TIB-Molbiol LightMix® SarbecoV E-gene assay; all positive 
dard(s) cases confirmed by reference laboratory of Hong Kong (Public Health Laboratory Ser- 
vice Branch, PHLSB). 


Definition of non-COVID cases: As for cases (single negative) 
Genetic target(s): Not stated 

Samples used: DTS or LRT; as per index test 

Timing of reference standard: Not stated 


Blinded to index test: Yes; conducted first (upon receipt, all samples were screened with 
our standard-of-care assay) 


Incorporated index test: No 


Flow and timing Time interval between index and reference tests: Simultaneous (Same samples) 





Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 298 
Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 
Collaboration. 


Trusted evidence. 


Better health. 


+‘ Cochrane 
tw Library 


Informed decisions. 


Cochrane Database of Systematic Reviews 





Wong 2020 (Continued) 


Comparative 


Notes 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sample of 
patients enrolled? 


Was a case-control design avoided? 


Did the study avoid inappropriate exclu- 
sions? 


Did the study avoid inappropriate inclu- 
sions? 


Could the selection of patients have in- 
troduced bias? 


Are there concerns that the included 
patients and setting do not match the 


review question? 


DOMAIN 2: Index Test (Antigen tests) 


All patients received same reference standard: Yes 

Missing data: None reported 

Uninterpretable results: None reported 

Indeterminate results (index test): None reported 
Indeterminate results (reference standard): None reported 


Unit of analysis: Samples (162/158) 


Funding: This research did not receive any specific grant from funding agencies in the 
public, commercial, or not-for-profit sectors. 


Publication status: Published 
Source: J Clin Virol 


Author COI: The authors report no declarations of interest. 


Authors' judgement Risk of bias Applicability concerns 


Unclear 


Yes 


Unclear 


Unclear 


Unclear risk 


Unclear 


DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test results interpreted 
without knowledge of the results of the 
reference standard? 


If a threshold was used, was it pre-speci- 
fied? 


Could the conduct or interpretation of 
the index test have introduced bias? 


Unclear 


Unclear 


Unclear risk 
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Wong 2020 (Continued) 


Are there concerns that the index test, 
its conduct, or interpretation differ 
from the review question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to cor- 
rectly classify the target condition? 


Were the reference standard results inter- 
preted without knowledge of the results 


of the index tests? 


Reference standard does not incorporate 
result of index test? 


Could the reference standard, its con- 
duct, or its interpretation have intro- 
duced bias? 


Are there concerns that the target con- 
dition as defined by the reference stan- 
dard does not match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval be- 
tween index test and reference standard? 


Did all patients receive the same refer- 
ence standard? 


Were all patients included in the analysis? 


Did all participants receive a reference 
standard? 


Were results presented per patient? 


Could the patient flow have introduced 
bias? 


Young 2020 


Study characteristics 


Patient Sampling 


No 


Yes 


Yes 


High risk 


Yes 


Yes 


Unclear 


Yes 


No 


High risk 


Single group study to estimate sensitivity and specificity: 


High 


High 


- Patients with one or more symptoms of COVID-19 (within <=7 days post symptom onset) at 21 
study sites (n=260) 
[Second cohort of 361 samples from COVID suspects <=5 days p.s.o. also evaluated to compare 


BD Veritor with Quidel Sofia® 2 SARS Antigen FIA but excluded from review as only discrepant 
results on the two Ag assays underwent RT-PCR] 


Recruitment: Not stated 


Prospective or retrospective: Prospective 
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Young 2020 (Continued) 


Patient characteristics and setting 


Index tests 


Target condition and reference 
standard(s) 


Flow and timing 


Setting: Mixed; drive-through/tent (n=42), outpatient clinic (n=74), research clinic (n=72), or 
skilled nursing facility (n=66) 


Location: Unclear; 21 geographically diverse study sites [Author institutions BD Life Sciences, 
Louisiana State University Health Sciences Center, Tricore Reference Laboratory) 


Country: USA 

Dates: June 5-11, 2020 

Symptoms and severity: 110 (43%) cough, 98 (39%) muscle pain, 95 (37%) headache, 90 (35%) 
sore throat, 90 (35%) sore throat, 78 (31%) fever. 

Of those at <=6 days p.s.o (n=245): 94 (38%) with one symptom, 151 (62%) with >= 2 symptoms 
Demographics: median age 43 (range 18 to 90); 91 (36%) male 


Exposure history: 


Test name: BD Veritor SARS-CoV-2 antigen test (no product codes) 


Manufacturer: Becton, Dickinson and Company, BD Life Sciences—Integrated Diagnostic Solu- 
tions, San Diego, CA 


Antibody: NP 

Antigen target: not stated 

Test method: Not stated; chromatographic immunoassay with analyser 

Samples used: Nasal; clinician collected from both nostrils (same swab) 

Transport media: dry nasal swabs 

Sample storage: Swabs were shipped for testing on dry ice (-70°C); 

Test operator: Not stated; Veritor testing was performed internally at BD (San Diego, CA, USA) 
Definition of test positivity: As per manufacturer 

Blinding reported: Yes; all personnel blinded to all other test results 

Timing of samples: All <=7 days p.s.o; median 3.0 d, mean 3.2 d. 


38 (15%) 1 day p.s.o, 57 (23%) 2 days, 54 (22%) 3 days, 40 (16%) 4 days, 37 (15%) 5 days, 19 (8%) 
6 days, 6 (2%) 7 days 


Reference standard: Lyra® SARS-CoV-2 PCR Assay (Quidel Corporation. Athens, OH); BD MAX™ 
real time SARS-CoV-2 PCR assay used for discordant testing 


Definition of non-COVID cases: As for cases (single negative) 
Genetic target(s): Not stated 


Samples used: NP (n= 217) or OP (n=34); clinician collected (if an NP swab was collected as part 
of SOC, the participant had the option of having an OP study swab taken in lieu of a second NP 
swab) 


Timing of reference standard: Swabs taken prior to any study swabs (potential for contamina- 
tion of nasal cavity) 


Blinded to index test: Yes; performed at TriCore Reference Laboratories. 
"All testing was conducted with all personnel blinded to all other test results" 


Incorporated index test: No 


Time interval between index and reference tests: Simultaneous (paired) 
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Young 2020 (Continued) 


Comparative 


Notes 


Methodological quality 
Item 
DOMAIN 1: Patient Selection 


Was a consecutive or random sam- 
ple of patients enrolled? 


Was a case-control design avoid- 
ed? 


Did the study avoid inappropriate 
exclusions? 


Did the study avoid inappropriate 
inclusions? 


Could the selection of patients 
have introduced bias? 


Are there concerns that the in- 
cluded patients and setting do 
not match the review question? 


All patients received same reference standard: Yes 


Missing data: 9 excluded; 6 did not meet eligibility criteria and 3 had invalid specimens/results 
(2 on RT-PCR and 1 labelling error) 


Uninterpretable results: 3 invalid on at least one assay 
Indeterminate results (index test): None reported 


Indeterminate results (reference standard): None reported. Re-test of 9 'FN' results with BD 
MAX RT-PCR resulted in 2 confirmed FN (BD MAX +ve and sero +ve), 6 were BD Max -ve (incl 1 
sero +ve) and 1 invalid (no result) 


Unit of analysis: Patients 


Funding: Study was funded by Becton, Dickinson and Company; BD Life Sciences—Integrated 
Diagnostics Solutions. Non-BD employee authors received research funds as part of this work 


Publication status: Pre-print 
Source: medRxiv 


Author COI: CRD, CF, KE, JCA, HR, and CKC are employees of Becton, Dickinson and Company; 
SY, None; CC, None; AM, None; CGF, None; CB, None; JA, None; RA, CEO and PI of Comprehen- 
sive Clinical Research LLC 


Authors' judgement Risk of bias Applicability concerns 


Unclear 


Yes 


Yes 


Yes 


Unclear risk 


Unclear 


DOMAIN 2: Index Test (Antigen tests) 


Were the index test results inter- 
preted without knowledge of the 
results of the reference standard? 


Yes 
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Young 2020 (Continued) 


If a threshold was used, wasit pre- Yes 
specified? 


Could the conduct or interpreta- Low risk 
tion of the index test have intro- 
duced bias? 


Are there concerns that the in- High 
dex test, its conduct, or inter- 

pretation differ from the review 

question? 


DOMAIN 2: Index Test (Rapid molecular tests) 
DOMAIN 3: Reference Standard 


Is the reference standards likely to No 
correctly classify the target condi- 
tion? 


Were the reference standard re- Yes 
sults interpreted without knowl- 

edge of the results of the index 

tests? 


Reference standard does not in- Yes 
corporate result of index test? 


Could the reference standard, High risk 
its conduct, or its interpretation 
have introduced bias? 


Are there concerns that the tar- High 
get condition as defined by the 

reference standard does not 

match the question? 


DOMAIN 4: Flow and Timing 


Was there an appropriate interval Yes 
between index test and reference 
standard? 

Did all patients receive the same Yes 


reference standard? 


Were all patients included in the No 
analysis? 


Did all participants receive arefer- Yes 
ence standard? 


Were results presented per pa- Yes 
tient? 


Could the patient flow have in- High risk 
troduced bias? 
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Zhen 2020 [A] 


Study characteristics 


Patient Sampling 2-group study to estimate sensitivity and specificity: 
- samples from symptomatic patients of all ages and gender 


Recruitment: not stated; specimens selected to represent the true positivity rate at au- 
thors' institution (50% to 60%), and to span low and high viral loads 


Prospective or retrospective: mixed; included frozen samples (n = 88) and prospectively 
tested (n = 20) 


Number of samples (samples with confirmed SARS-CoV-2):108 (58) 


Patient characteristics and setting Setting: not stated; selected from laboratory 


Location: not stated; authors' institutions were Northwell Health Laboratories, and Dept 
Pathology and Laboratory Medicine, The Donald and Barbara Zucker School of Medicine 


Country: USA 

Dates: March-April 2020 

Symptoms and severity: "symptomatic"; no further details 
Demographics: not stated (all ages and genders) 


Exposure history: not stated 


Index tests Zhen 2020 [A] is the entry for test [A] from the list below 
Test name: 
[A] Xpert® Xpress SARS-CoV-2 
[B] ID NOW COVID-19 
(no product codes reported) 
Manufacturer: [A] Cepheid, [B] Abbott 
Antigen target: [A] N2, E; [B] RdRp 
Antibody: N/A 
Test method: rapid PCR 
Samples used: NP swabs 
Transport media: UTM (various manufacturers) 
Sample storage: on collection, stored at 2-8 °C for up to 72 h; after routine testing, stored 
at -80 °C 
88 samples tested using ePlex on collection, then frozen prior to testing with ID NOW, 


Xpert Xpress and Hologic RT-PCR; 20 samples tested prospectively after collection on all 
systems 


Test operator: not stated; presume laboratory staff 


Definition of test positivity: not stated; states “testing was performed according to the 
manufacturer’s instructions” but no presumptive positives reported 


Blinding reported: not stated 


Timing of samples: not stated 
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Zhen 2020 [A] (Continued) 


Target condition and reference stan- 
dard(s) 


Flow and timing 


Study also evaluates [C] GenMar kePlex® SARS-CoV-2 Test (not eligible for this review) 


Reference standard: RT-PCR; Hologic Panther Fusion SARS-CoV-2 assay, performed ac- 
cording to manufacturer's IFU 


Definition of non-COVID cases: single RT-PCR 

Genetic target(s): 2 regions of ORF1ab; either positive 
Samples used: NP swabs; same as for index test 
Timing of reference standard: not stated 

Blinded to index test: not stated 


Incorporated index test: no 


Time interval between index and reference tests: not stated in exact terms; delay be- 


Comparative 


Notes 


tween index and reference only for GenMark assay, as 88 samples tested at time of collec- 
tion with ePlex then frozen before testing with all other assays. 


All participants received same reference standard: yes 
Missing data: none reported, no participant flow diagram reported 


Uninterpretable results: 1 specimen with invalid result on ID NOW was excluded from that 
dataset 


Indeterminate results (index test): none reported; no re-testing conducted 
Indeterminate results (reference standard): none reported; no re-testing conducted 


Unit of analysis: not stated only refers to samples 


Funding: none stated; study authors thank Cepheid for providing the reagents used 


Publication status: accepted manuscript 
Source: Journal of Clinical Microbioloby 


Author COI: Gregory Berry has previously given education seminars for Abbott, Cepheid, 
and Hologic, Inc. and has received Honorariums 


Methodological quality 


Authors' judgement Risk of bias Applicability concerns 





Item 
DOMAIN 1: Patient Selection 
Was a consecutive or random sample of No 
patients enrolled? 
Was a case-control design avoided? No 
Did the study avoid inappropriate exclu- Unclear 
sions? 
Did the study avoid inappropriateinclu- Yes 
sions? 
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Zhen 2020 [A] (continued) 
Could the selection of patients have 
introduced bias? 


Are there concerns that the included 
patients and setting do not match the 
review question? 


DOMAIN 2: Index Test (Antigen tests) 


High risk 


DOMAIN 2: Index Test (Rapid molecular tests) 


Were the index test results interpreted 
without knowledge of the results of the 
reference standard? 


If a threshold was used, was it pre-spec- 
ified? 


Could the conduct or interpretation of 
the index test have introduced bias? 


Are there concerns that the index test, 
its conduct, or interpretation differ 
from the review question? 


DOMAIN 3: Reference Standard 


Is the reference standards likely to cor- 
rectly classify the target condition? 


Were the reference standard results in- 
terpreted without knowledge of the re- 
sults of the index tests? 


Reference standard does not incorpo- 
rate result of index test? 


Could the reference standard, its con- 
duct, or its interpretation have intro- 
duced bias? 


Are there concerns that the target 
condition as defined by the reference 
standard does not match the ques- 
tion? 


DOMAIN 4: Flow and Timing 
Was there an appropriate interval be- 
tween index test and reference stan- 


dard? 


Did all patients receive the same refer- 
ence standard? 


Were all patients included in the analy- 
sis? 


Unclear 


Yes 


Unclear risk 


No 


Unclear 


Yes 


High risk 


Yes 


Yes 


No 


High 


High 


High 
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Zhen 2020 [A] (Continued) 

Did all participants receive a reference Yes 

standard? 

Were results presented per patient? Unclear 

Could the patient flow have intro- High risk 

duced bias? 
Zhen 2020 [B] 

Study characteristics 


Patient Sampling 


Patient characteris- 
tics and setting 


Index tests 


Target condition 
and reference stan- 
dard(s) 


Flow and timing 


See Zhen 2020 [A] for full study details and QUADAS entries 


See Zhen 2020 [A] for full study details and QUADAS entries 


Zhen 2020 [B] is the entry for test [B] from the list below, see Zhen 2020 [A] for full study details and QUADAS 
entries 


Test name: 

[A] Xpert® Xpress SARS-CoV-2 

[B] ID NOWCOVID-19 

(no product codes reported) 
Manufacturer: [A] Cepheid, [B] Abbott 
Antigen target: [A] N2, E; [B] RdRp 
Antibody: N/A 

Test method: rapid PCR 

Samples used: NP swabs 


Transport media: UTM (various manufacturers) 


Sample storage: on collection, stored at 2-8 °C for up to 72 h; after routine testing, stored at -80 °C 
88 samples tested using ePlex on collection, then frozen prior to testing with ID NOW, Xpert Xpress and Holog- 
ic RT-PCR; 20 samples tested prospectively after collection on all systems 


Test operator: not stated; presume laboratory staff 


Definition of test positivity: not stated; states “testing was performed according to the manufacturer’s instruc- 
tions” but no presumptive positives reported 


Blinding reported: not stated 
Timing of samples: not stated 


Study also evaluates [C] GenMar kePlex® SARS-CoV-2 Test (not eligible for this review) 


See Zhen 2020 [A] for full study details and QUADAS entries 


See Zhen 2020 [A] for full study details and QUADAS entries 
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Zhen 2020 [B] (continued) 





Comparative 


Notes Funding: none stated; study authors thank Cepheid for providing the reagents used 
Publication status: accepted manuscript 
Source: Journal of Clinical Microbioloby 


Author COI: Gregory Berry has previously given education seminars for Abbott, Cepheid, and Hologic, Inc. and 
has received Honorariums 


BAL: bronchoalveolar lavage; CDC: Center for Disease Control; CGIA: colloidal gold immunoassay; COI: conflict of interest; Ct: cycle 
threshold; ED: Emergency Department; EUA: emergency use authorisation; FIA: fluorescence immunochromatographic; FN: false 
negative; FP: false positive; GLY: Glucose-Lactalbumin-Yeast; HCW: healthcare worker; ICU: intensive care unit; IFU: instructions 
for use; IQR: interquartile range; LDT: laboratory-developed test; N/A: not applicable; NAAT: nucleic acids amplification test; NIH: 
National Institutes of Health; NOP: naso-oropharyngeal; NP: nasopharyngeal; OP: oropharyngeal; PCR: polymerase chain reaction; PHE: 
Public Health England; qRT-PCR: quantitative reverse transcription polymerase chain reaction; RNA: ribonucleic acid; RT-PCR: reverse 
transcription polymerase chain reaction; SD: standard deviation; TA: tracheal aspirate; TN: true negative; TP: true positive; UTM: universal 
transport medium; UV: ultraviolet; UW: University of Washington; VTM: viral transport medium; 


Characteristics of excluded studies [ordered by study ID] 





Study Reason for exclusion 
Ai 2020 Ineligible index test 
Anahtar 2020 Ineligible index test 
Ar Gouilh 2020 Ineligible index test 
Arizti-Sanz 2020 Ineligible index test 
Arumugam 2020 Ineligible index test 
Avetyan 2020 Ineligible index test 
Azhar 2020 Ineligible index test 
Azzi 2020 Ineligible index test 
Baek 2020 Ineligible index test 
Barra 2020 Ineligible study design 
Basu 2020 Ineligible reference standard 
Behrmann 2020 Accuracy data cannot be extracted 
Bokelmann 2020 Ineligible index test 
Bordi 2020 Ineligible index test 
Brandsma 2020 Ineligible index test 
Broughton 2020 Ineligible index test 
Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 308 


Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 
Collaboration. 


Cochrane 


G) tir 


Trusted evidence. 
Informed decisions. 
Better health. 


Cochrane Database of Systematic Reviews 





Study 

Bull 2020 

Bulterys 2020 
Callahan 2020a 
Callahan 2020b 
Chandler-Brown 2020 
Chen 2020b 

Chow 2020 

CNR 2020 

CNR 2020a 

Colson 2020 

Comar 2020 

Comer 2020 

Crone 2020 

Curti 2020 

Davda 2020 

Ding 2020a 

Ding 2020b 

Dohla 2020 

Dong 2020 
El-Tholoth 2020 
Farfan 2020 

FIND 2020f 

Fowler 2020 

Francis 2020 
Freire-Paspuel 2020a 
Freire-Paspuel 2020b 


Ganguli 2020 


Giamarellos-Bourboulis 2020 


Reason for exclusion 

Ineligible index test 

Ineligible index test 

Accuracy data cannot be extracted 
Ineligible index test 

Ineligible study design 

Ineligible index test 

Ineligible index test 

Insufficient details in study report 
Insufficient details in study report 
Inadequate sample size 

Ineligible reference standard 
Ineligible population 

Ineligible index test 

Ineligible study design 

Ineligible index test 

Ineligible study design 

Ineligible index test 

Ineligible index test 

Ineligible index test 

Ineligible study design 

Ineligible study design 
Superseded by Kruger 2020(a) 
Ineligible index test 

Ineligible study design 

Ineligible study design 

Ineligible index test 

Ineligible population 


Ineligible study design 
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Study 
Gonzalez-Gonzalez 2020a 
Gonzalez-Gonzalez 2020b 
Grant 2020 
Hass 2020 
Herrera 2020 
Hirotsu 2020 
Hogan 2020a 
Howson 2020 
Hu 2020 

Huang 2020 
Huang 2021 
James 2020 
Jiang 2020 
Joung 2020 
Joung 2020a 
Kalikiri 2020 
Kashiwagi 2020 
Kim 2019 

Kim 2020 
Konrad 2020 
Kurstjens 2020 
Kyosei 2020 
Lalli 2020 
Lamb 2020 
Landry 2020 
Lee 2020 

Le Hingrat 2020 


Li 2020 


Reason for exclusion 
Ineligible study design 
Ineligible population 
Ineligible index test 
Ineligible target condition 
Ineligible reference standard 
Ineligible index test 
Ineligible index test 
Ineligible study design 
Ineligible index test 
Ineligible index test 
Ineligible study design 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Inadequate sample size 
Ineligible study design 
Ineligible index test 
Ineligible study design 
Ineligible index test 
Ineligible study design 
Inadequate sample size 
Ineligible study design 
Ineligible index test 
Ineligible index test 
Ineligible index test 


Ineligible index test 
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Study 

Lin 2020 

Liotti 2020a 
Lowe 2020 

Lu 2020 

Lu 2020a 

Lubke 2020 
Mahari 2020 
Marais 2020 
Marzinotto 2020 
McCormick-Baw 2020 
McDonald 2020 
McRae 2020 

Mei 2020 
Meyerson 2020 
Michel 2020 
Mlcochova 2020 
Mohon 2020 
Moses 2020 
Mostafa 2020 
Muraoka 2020 
Nachtigall 2020 
Newman 2020 
Noerz 2020 
Ogawa 2020 
Osterdahl 2020 
Paden 2020 
Patchsung 2020 


Pellanda 2020 


Reason for exclusion 
Ineligible population 
Ineligible index test 
Ineligible index test 
Ineligible study design 
Ineligible index test 
Ineligible index test 
Ineligible study design 
Ineligible index test 
Accuracy data cannot be extracted 
Ineligible reference standard 
Ineligible reference standard 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible study design 
Ineligible study design 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Inadequate sample size 
Ineligible index test 
Ineligible study design 
Ineligible index test 


Ineligible index test 
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Study 

Peto 2020 
Pfefferle 2020 
Pollock 2020a 
Qian 2020 
Rabe 2020 
Rauch 2020 
Rodel 2020 
Rodriguez-Manzano 2020 
Seo 2020 
Shirato 2020 
Singh 2020a 
Singh 2020b 
Smyrlaki 2020 
St Hilaire 2020 
Tan 2020 


Tanida 2020 


Tibbetts 2020 
Tran 2020 
Visseaux 2020 
Wang 2020a 
Wang 2020b 
Wang 2020c 
Wee 2020 

Wu 2020 

Xue 2020 

Yan 2020 


Yang 2020b 


Reason for exclusion 
Ineligible index test 
Ineligible study design 
Ineligible index test 
Ineligible index test 
Ineligible population 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Accuracy data cannot be extracted 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible index test 


Ineligible study design 


Ineligible index test; also preselected on cycle threshold (only < 34 cycle threshold in- 


cluded) 

Ineligible index test 
Ineligible population 
Ineligible index test 
Ineligible index test 
Accuracy data cannot be extracted 
Ineligible index test 
Ineligible study design 
Ineligible index test 
Ineligible index test 
Ineligible index test 


Ineligible index test 
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Yu 2020a Ineligible index test 
Yu 2020b Ineligible index test 
Yu 2020c Ineligible index test 
Zamecnik 2020 Ineligible index test 
Zeng 2020 Ineligible study design 
Zhang 2020 Ineligible index test 
Zhao 2020 Ineligible study design 
Zhu 2020 Ineligible index test 
DATA 


Presented below are all the data for all of the tests entered into the review. 


Table Tests. Data tables by test 





Test No. of studies No. of participants 
1 Antigen tests - All 58 23143 
2 Antigen tests - symptomatic 42 16346 
3 Antigen tests - asymptomatic 13 1596 
4 Antigen tests - mixed symptoms or not reported 20 5447 
5 Antigen tests - Ct values < or <=25 36 3827 
6 Antigen tests - Ct values >25 36 2632 
7 Antigen tests - Ct values < or <=32/33 15 2127 
8 Antigen tests - Ct values >32/33 15 346 
9 Antigen tests - other Ct thresholds for 'higher' viral load 13 1760 
10 Antigen tests - other Ct thresholds for 'lower' viral load 13 739 
11 Antigen tests - week 1 after symptom onset 26 5769 
12 Antigen tests - week 2 after symptom onset 22 935 
13 Molecular tests - all 32 4537 
14 Molecular tests - all (before discrepant analysis) 6 1533 
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Test 

15 Molecular tests - all (after discrepant analysis) 

16 Molecular tests - Ct values < or <=30 

17 Molecular tests - Ct values >30 

18 Molecular tests - other Ct thresholds for 'higher' viral load 
19 Molecular tests - other Ct thresholds for 'lower' viral load 
20 Molecular tests - other sites 

21 Antigen tests - direct comparisons 

22 AAZ - COVID-VIRO (CGIA) 

23 Abbott - Panbio Covid-19 Ag (CGIA) 

24 Becton Dickinson - BD Veritor (LFA - method not specified) 
25 BIONOTE - NowCheck COVID-19 Ag (LFA - method not specified) 
26 Biosynex - Biosynex COVID-19 Ag BSS (CGIA) 

27 Coris Bioconcept - COVID-19 Ag Respi-Strip (CGIA) 

28 E25Bio - DART (NP) (CGIA) 

29 Fujirebio - ESPLINE SARS-CoV-2 [LFA(ALP)] 

30 Inhouse (Bioeasy co-author) - n/a (FIA) 

31 Innova Medical Group - Innova SARS-CoV-2 Ag (CGIA) 

32 Liming Bio-Products - StrongStep® COVID-19 Ag (CGIA) 

33 Quidel Corporation - SOFIA SARS Antigen (FIA) 

34 RapiGEN - BIOCREDIT COVID-19 Ag (CGIA) 

35 Roche - SARS-CoV-2 (LFA - method not specified) 


36 Savant Biotech - Huaketai SARS-CoV-2 N Protein (LFA - method not speci- 
fied) 


37 SD Biosensor - STANDARD F COVID-19 Ag (FIA) 
38 SD Biosensor - STANDARD Q COVID-19 Ag (CGIA) 
39 Shenzhen Bioeasy Biotech - 2019-nCoV Ag (FIA) 
40 Abbott - ID NOW (Isothermal PCR) 


41 Cepheid - Xpert Xpress (Automated RT-PCR) 


No. of studies 


11 


11 


13 


15 


No. of participants 
1533 
204 
149 
75 
168 
316 
3631 
880 
5691 
727 
400 
634 
1781 
190 
265 
239 
3904 
19 
64 
2170 
73 


109 


1552 
3480 
965 

1949 


1781 
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Test No. of studies No. of participants 
42 DNANudge - COVID Nudge (Automated RT-PCR) 1 386 
43 DRW - SAMBA II (Automated RT-PCR) 2 321 
44 Mesa Biotech - Accula (other molecular) 1 100 
45 Antigen test evaluations - Single group design 29 15336 
46 Antigen test evaluations - Two group design 20 5729 
47 Antigen test evaluations - Unclear design 2 549 
48 Molecular test evaluations - Single group design 18 2899 
49 Molecular test evaluations - Two group design 9 1265 
50 Molecular test evaluations - Unclear design 2 187 
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Better health. Cochrane Database of Systematic Reviews 
Test 1. Antigen tests - All 

Antigen tests - All 
Study TP FP FN_~ TN Sensitivity (95% CI} Specificity (95% CI) Sensitivity (95% Cl)Specificity (95% CI} 
Albert 2020 43 0 11 358 0.80 [0.66, 0,89] 1,00 [0.99, 1.00] == LJ 
Alemany 2020 872 3 79 450 0,92 [0,90, 0,93] 0,99 [0.97, 1.00] Ld LJ 
Billaud 2020 53 5 46 358 0.54 [0.43, 0.64] 0.99 [0.97, 1.00] a Ls 
Blairon 2020 8 0 21 26 0.30 [0.15, 0.49] 1,00 [0.87, 1.00] —— 4 
Cerutti 2020 77 0 32 221 0.71 [0.61, 0.79] 1.00 [0.98, 1.00] +s LJ 
Courtellemont 2020 97 20 4 127 0.96 [0.90, 0,99] 0,86 [0.80, 0.91] al all 
Diao 2020 141 O 67 31 0.68 [0.61, 0.74] 1.00 [0.89, 1.00] * al 
Fenollar 2020{a} 144 O 38 0 0.79 (0.72, 0.85] Not estimable +. 
Fenollar 2020(b} 10 7 412 = «130 0.45 [0.24, 0,68] 0,95 [0.90, 0,98] —_—— al 
FIND 2020a 91 8 11 290 0.89 [0.82, 0.94] 0.97 [0.95, 0.99] + a 
FIND 2020b 106 0 18 411 0.85 (0.78, 0,91] 1,00 [0.99, 1.00] all : 
FIND 2020c {BR} 94 7 12 287 0.89 [0.81, 0.94] 0.98 [0.95, 0.99] + a 
FIND 2020c {CH} 170 2 Zl sa? 0.89 [0.84, 0.93] 1.00 [0.98, 1.00] + : 
FIND 2020d (BR} 93 7 27 326 0.78 [0.69, 0,85] 0.98 [0.96, 0.99] +> Lal 
FIND 2020d (DE} 27 20 12 «617 0.69 [0.52, 0.83] 0.97 [0.95, 0.98] — a 
FIND 2020e (BR} 87 4 30 355 0.74 [0.65, 0,82] 0,99 [0.97, 1,00] ail a 
FIND 2020e (DE} 13° 0 12 1214 0.52 [0.31, 0.72] 1.00 [1.00, 1.00] —— LJ 
Fourati 2020 [A] 103 0 189 337 0,35 [0.30, 0,41] 1.00 [0.99, 1.00] * LJ 
Fourati 2020 [B] 175 23 116 314 0.60 [0.54, 0.66] 0.93 [0.90, 0.96] * a 
Fourati 2020 [C] 163 0 132 337 0.55 [0.49, 0.61] 1.00 [0.99, 1.00] * : 
Fourati 2020 [D] 177 0 120 337 0.60 [0.54, 0,65] 1.00 [0.99, 1.00] all : 
Fourati 2020 [E] 182 0 113 337 0.62 [0.56, 0.67] 1.00 [0.99, 1.00] 7 Ld 
Gremmels 2020{a) 101 0 39 1228 0.73 [0.64, 0,80] 1,00 [1.00, 1.00] . 
Gremmels 2020(b) SL O&O 12 145 0.81 [0.69, 0.90] 1.00 [0.97, 1.00] + a 
Gupta 2020 63 1 4 252 0,82 [0.71, 0.90] 1,00 [0.98, 1.00] + : 
Kruger 2020(a)} 10 49 5S 663 0.67 [0.38, 0,88] 0,93 [0.91, 0,95] —— Ld 
Kruger 2020(b) 417 4 392 0.50 [0.16, 0.84] 0.96 [0.93, 0.98] ——_ : 
Kruger 2020{c} 36 9 11 1207 0.77 [0.62, 0,88] 0,99 [0.99, 1.00] — Ld 
Lambert-Niclot 2020 47 0 147 44 0.50 [0.40, 0.60] 1.00 [0.92, 1.00] + 4 
Linares 2020 44 0 16 195 0.73 [0.60, 0,84] 1,00 [0.98, 1.00] +s LJ 
Liotti 2020 49 4 55 251 0.47 [0.37, 0.57] 0.98 [0.96, 1.00] +s Ls 
Mak 2020 51 0 109 6] 0.32 [0.25, 0.40] Not estimable 7 
Mertens 2020 76 1 56 195 0,58 [0.49, 0,66] 0,99 [0.97, 1,00] a Le 
Nagura-lkeda 2020 12 0 91 te] 0.12 [0.06, 0.19] Not estimable —& 
Nash 2020 80 8 20 82 0,80 [0.71, 0.87] 0.91 [0.83, 0,96] all all 
PHE 2020{a} 95 0 83 940 0.53 [0.46, 0.61] 1.00 [1.00, 1.00] > . 
PHE 2020(b} i130 33 105 0,28 [0.16, 0.43] 1.00 [0.97, 1.00] + a 
PHE 2020{c} [non-HCW tested] 214 5 158 1299 0.58 [0.52, 0.63] 1.00 [0.99, 1.00] * Ls 
PHE 2020({d) [HCW tested] 156 0 67 ie] 0.70 [0.63, 0.76] Not estimable 7 
PHE 2020(d) [Lab tested] 156 0 42 0 0.79 [0.72, 0.84] Not estimable as 
PHE 2020({e} 5 2 Oo 537 Not estimable 1.00 [0.99, 1.00] LJ 
Porte 2020a 77 60 5 45 0,94 [0.86, 0,98] 1,00 [0.92, 1.00] all 4 
Porte 2020b [A] 300«C«d 2 31 0,94 [0.79, 0,99] 0.97 [0.84, 1.00] — 4 
Porte 2020b [B] 29 #1 3 31 0.91 [0.75, 0.98] 0.97 [0.84, 1.00] — —- 
Schildgen 2020 [A] 14 4 28 27 0.33 [0.20, 0,50] 0,87 [0.70, 0.96] = — 
Schildgen 2020 [B] 21 7 21 24 0.50 [0.34, 0.66] 0.77 [0.59, 0.90] + —- 
Schildgen 2020 [C] 3725 «5 6 0.88 [0.74, 0.96] 0.19 [0.07, 0.37] oe 
Scohy 2020 32 0 74 42 0.30 [0.22, 0.40] 1.00 [0.92, 1.00] > = 
Shrestha 2020 40 0 7 66 0,85 [0.72, 0.94] 1.00 [0.95, 1.00] a a al 
Takeda 2020 so 0 12 100 0.81 [0.69, 0,90] 1.00 [0.96, 1,00] + al 
Van der Moeren 2020(a} 16 2 1 332 0.94 [0.71, 1.00] 0.99 [0.98, 1.00] — : 
Van der Moeren 2020(b} 98 0 27 ie] 0.78 [0.70, 0.85] Not estimable 7 
Veyrenche 2020 13 GO 32 20 0.29 [0.16, 0.44] 1.00 [0.83, 1.00] + — 
Weitzel 2020 [A] 49 0 30 30 0.62 [0.50, 0.73] 1,00 [0.88, 1.00] +s 4 
Weitzel 2020 [B] o t 9 9 0.00 [0.00, 0,34] 0.90 [0.55, 1.00] #—— — 
Weitzel 2020 [C] 13 GO 65 31 0.17 [0.09, 0.27] 1.00 [0.89,1.00]) — 4 
Weitzel 2020 [D] 68 0 12 31 0,85 [0,75, 0,92] 1,00 [0,89, 1,00] ll 4 
Young 2020 29 #1 9 212 0.76 [0.60, 0.89] 1.00 [0.97, 1.00] k ' a. ' by 
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Antigen tests - symptomatic 


Test 2. Antigen tests - symptomatic 


FN TN Sensitivity (95% CI) Specificity (95% Cl} Sensitivity (95% ClSpecificity (95% Cl} 


Study TP FP 

Albert 2020 43° 0 11 358 
Alemany 2020 388 #0 31 27 
Billaud 2020 40 4 34 69 
Cerutti 2020 75 OQ 29 81 
Courtellemont 2020 97 20 4 127 
Fenollar 2020(a)} 144 0 38 is) 
FIND 2020a 91 8 11 290 
FIND 2020b 106 O 18 411 
FIND 2020c (BR) $4 7 12 287 
FIND 2020c (CH) 170 1 21 337 
FIND 2020d {BR} 93 7 27 326 
FIND 2020d (DE} 27 20 12 «617 
FIND 2020e (BR) 87 4 30 355 
Fourati 2020 [A] 103 0189 337 
Fourati 2020 [B] 175 23 116 314 
Fourati 2020 [C] 163 0132 337 
Fourati 2020 [D] 177 0 120 337 
Fourati 2020 [E] 182 0113 337 
Gremmels 2020(a} s9 0 37 1185 
Kruger 2020(a} 10 49 5 663 
Kruger 2020{c)} a2: 7 7 972 
Linares 2020 39 0 11 133 
Nagura-lkeda 2020 10 O 78 te) 
PHE 2020{a} 95 0 83 940 
PHE 2020(c} [non-HCW tested] 214 5 158 1299 
PHE 2020(d) [HCW tested] 156 0 67 0 
PHE 2020(d) [Lab tested] 156 0 42 0 
Porte 2020a 77) 60 5 45 
Porte 2020b [A] 300C«@d 2 31 
Porte 2020b [B] 29 #1 3 31 
Schildgen 2020 [A] 3 3 Fé 10 
Schildgen 2020 [B] 4 2 6 11 
Schildgen 2020 [C] 10 12 i?) 1 
Scohy 2020 25 QO 52 te] 
Van der Moeren 2020(a) 16 2 1 332 
Van der Moeren 2020(b} 98 0 27 0 
Veyrenche 2020 13° 0 32 20 
Weitzel 2020 [A] 49 0 30 30 
Weitzel 2020 [B] ool 9 tS) 
Weitzel 2020 [C] 13° 0 65 31 
Weitzel 2020 [D] 68 oO 12 31 
Young 2020 29 #1 9 212 


Antigen tests - asymptomatic 


0.80 [0.66, 0.89] 
0.93 [0.90, 0,95] 
0.54 [0.42, 0.66] 
0.72 [0.62, 0,80] 
0.96 [0.90, 0,99] 
0.79 [0.72, 0.85] 
0.89 [0.82, 0,94] 
0.85 [0.78, 0.91] 
0.89 [0.81, 0,94] 
0.89 [0.84, 0.93] 
0.78 [0.69, 0,85] 
0.69 [0.52, 0.83] 
0.74 [0.65, 0.92] 
0.35 [0.30, 0.41] 
0.60 [0.54, 0.66] 
0.55 [0.49, 0.61] 
0.60 [0.54, 0.65] 
0.62 [0.56, 0.67] 
0.73 [0.65, 0.80] 
0.67 [0.38, 0.98] 
0.82 [0.66, 0,92] 
0.78 [0.64, 0.98] 
0.11 [0.06, 0.20] 
0.53 [0.46, 0.61] 
0.58 [0.52, 0.63] 
0.70 [0.63, 0.76] 
0.79 [0.72, 0.84] 
0.94 [0.86, 0.98] 
0.94 [0.79, 0,99] 
0.91 [0.75, 0.98] 
0.30 [0.07, 0.65] 
0.40 [0.12, 0.74] 
1.00 [0.69, 1.00] 
0.32 [0.22, 0.44] 
0.94 [0.71, 1.00] 
0.78 [0.70, 0,85] 
0.29 [0.16, 0.44] 
0.62 [0.50, 0.73] 
0.00 [0.00, 0,34] 
0.17 [0.09, 0.27] 
0.85 [0.75, 0,92] 
0.76 [0.60, 0.99] 


1,00 [0,99, 1,00] 
1,00 [0.87, 1,00] 
0,95 [0.87, 0,98] 
1.00 [0.96, 1.00] 
0,86 [0.80, 0.91] 

Not estimable 
0,97 [0,95, 0,99] 
1.00 [0.99, 1.00] 
0.98 [0.95, 0.99] 
1.00 [0.98, 1.00] 
0.98 [0.96, 0,99] 
0,97 [0,95, 0,98] 
0,99 [0.97, 1.00] 
1,00 [0.99, 1,00] 
0,93 [0.90, 0.96] 
1,00 [0.99, 1.00] 
1,00 [0.99, 1.00] 
1,00 [0.99, 1.00] 
1.00 [1.00, 1,00] 
0,93 [0.91, 0.95] 
0,99 [0.99, 1,00] 
1,00 [0.97, 1.00] 

Not estimable 
1,00 [1.00, 1.00] 
1.00 [0.99, 1.00] 

Not estimable 

Not estimable 
1,00 [0,92, 1,00] 
0,97 [0.84, 1,00] 
0,97 [0.84, 1.00) 
0.77 [0.46, 0.95] 
0,85 [0.55, 0,98] 
0,08 [0,00, 0,36] 
1,00 [0.66, 1.00] 
0.99 [0.98, 1.00] 

Not estimable 
1.00 [0.83, 1.00] 
1,00 [0.88, 1.00] 
0,90 [0.55, 1,00] 
1,00 [0.89, 1.00) 
1,00 [0.89, 1.00] 
1.00 [0.97, 1,00] 
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TN Sensitivity (95% Cl} Specificity (95% Cl) Sensitivity (95% Cl)Specificity (95% Ch} 


Study TP FP FN 

Alemany 2020 93 5S 24 365 
Billaud 2020 13. #1 #12 289 
Cerutti 2020 2 0 3 140 
Fenollar 2020(b} 10 7 12 130 
Gremmels 2020{a)} 2 0 1 34 
Gupta 2020 9 1 4 113 
Linares 2020 5 0 5 62 
Nagura-lkeda 2020 2 013 0 
Schildgen 2020 [A] 4 1 9$§ 13 
Schildgen 2020 [B] 5 4 8 190 
Schildgen 2020 [C] 11.12. 2 Z 
Scohy 2020 4 0 10 31 
Shrestha 2020 40 0 Ff 66 


0.79 [0.71, 0.86] 
0,52 [0.31, 0.72] 
0.40 [0.05, 0.85) 
0.45 [0.24, 0.68] 
0.67 [0.09, 0.99] 
0.69 [0.39, 0.91] 
0,50 [0.19, 0.81] 
0,13 [0.02, 0.40] 
0,31 [0.09, 0.61] 
0.38 [0.14, 0.68] 
0,85 [0.55, 0,98] 
0.29 [0.08, 0.58] 
0.85 [0.72, 0.94] 


0,99 [0.97, 1.00] +7 a 
1,00 [0.98, 1.00] —_— a 
1,00 [0.97, 1.00) ———— a 
0,95 [0.90, 0.98] —_— a 
1,00 [0.90, 1,00] rr 4 
0,99 [0.95, 1.00] ———— a 
1,00 [0.94, 1.00] ——i-— 4a 
Not estimable —#— 

0.93 [0.66,1.00]) —— — 
0.71 [0.42, 0,92] —i—— —i— 
0,14 [0.02, 0.43] —_—-_ —— 

1,00 [0.89,1.00]) —— — 


1,00 [0.95,1.00] ,_, , , —H,, , , | | # 
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Test 4. Antigen tests - mixed symptoms or not reported 


Antigen tests - mixed symptoms or not reported 


Study TP FP FN~ TN Sensitivity (95% Cl} Specificity (95% Cl} Sensitivity (95% pore te {95% CI} 
Alemany 2020 391 0 24 58 0,94 [0.92, 0,96] 1.00 [0.94, 1.00] 4 
Billaud 2020 53.65 46 358 0.54 [0.43, 0,64] 0.99 [0.97, 1,00] +s : 
Blairon 2020 9 O 21 26 0,30 [0.15, 0,49] 1.00 [0,87, 1,00] —— — 
Cerutti 2020 77 GQ 32 221 0.71 [0,61, 0,79] 1.00 [0,98, 1,00] +a L 
Diao 2020 141 Oo 6&7 31 0,68 [0,61, 0,74] 1.00 [0.89, 1.00] * 4 
FIND 2020e (DE} 13°60 #12 1214 0,52 [0.31, 0,72] 1,00 [1,00, 1,00] —_— a 
Gremmels 2020(b} Sl 0 12 145 0,81 [0.69, 0,90] 1.00 [0.97, 1,00] + a 
Gupta 2020 63 1 14 252 0,82 [0.71, 0.90] 1,00 [0,98, 1.00] al Ld 
Lambert-Niclot 2020 47) 0 OF 44 0,50 [0.40, 0.60] 1.00 [0,92, 1.00] +s 4 
Linares 2020 44 0 16 195 0.73 [0.60, 0,84] 1.00 [0,98, 1,00] s+ E 
Liotti 2020 49 4 55 251 0.47 [0.37, 0.57] 0,98 [0,96, 1,00] +s LJ 
Mak 2020 51 © 109 6] 0,32 [0.25, 0.40] Not estimable - 

Mertens 2020 76 1 56 195 0.58 [0.49, 0,66] 0.99 [0.97, 1,00] +a Ld 
Nash 2020 8006820 82 0.80 [0.71, 0,87] 0,91 [0,83, 0,96] +s all 
PHE 2020({b} 13° 0 33 105 0,28 [0.16, 0.43] 1,00 [0.97, 1,00] + a 
Schildgen 2020 [A] 14 4 28 27 0,33 [0.20, 0.50] 0.87 [0.70, 0,96] + — 
Schildgen 2020 [B] 21 7 21 24 0,50 [0.34, 0.66] 0.77 [0.59, 0,90] + —i— 
Schildgen 2020 [C] 37 25 5 6 0.88 [0,74, 0,96] 0.19 [0.07, 0,37] >> -— 

Scohy 2020 32 0 74 42 0,30 [0,22, 0,40] 1,00 [0,92, 1,00] a 4 
Takeda 2020 so 0 12 100 0,81 [0.69, 0,90) 1.00 [0,96, 1.00] 


Antigen tests - Ct values < or <=25 
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Test 5. Antigen tests - Ct values < or <=25 


Study TP FP FN- TN Sensitivity (95% Cl} Specificity (95% Cl) Sensitivity (95% Cl)Specificity (95% Cl} 
Alemany 2020 557 0 6 ie] 0.99 [0.98, 1.00] Not estimable = 
Fenollar 2020(a) 106 Oo 4 ie] 0,96 [0.91, 0.99] Not estimable a 
Fenollar 2020(b) 10 0 0 1,00 [0.03, 1.00] Not estimable ———————————8 
FIND 2020a 55 0 3 0 0,95 [0.86, 0,99] Not estimable — 
FIND 2020b 90 0 3 i¢] 0.97 [0.91, 0.99] Not estimable 4a 
FIND 2020c (BR) 47 0 2 6] 0,96 [0,86, 1,00] Not estimable ad 
FIND 2020¢ (CH) 137 0 4 0 0,97 [0,93, 0.99] Not estimable a 
FIND 2020d {BR} 58 0 8 ie] 0,88 [0.78, 0.95] Not estimable +s 
FIND 2020d (DE) 20 0 O te] 1,00 [0,83, 1,00] Not estimable — 
FIND 2020e (BR) 560 0 5 i¢] 0,91 [0.80, 0.97] Not estimable + 
FIND 2020e (DE) 12 0 3 1214 0,80 [0.52, 0,96] 1,00 [1.00, 1.00] —_- LI 
Fourati 2020 [A] 91 0 37 8] 0,71 [0.62, 0,79] Not estimable a 
Fourati 2020 [B] 118 oO 8g ie] 0,93 [0.87, 0.97] Not estimable al 
Fourati 2020 [C] 113. 0 #417 i¢] 0,87 [0,80, 0,92] Not estimable all 
Fourati 2020 [D] 122 0 8 te] 0,94 [0,88, 0,97) Not estimable + 
Fourati 2020 [E] 125. 0 5 te] 0,96 [0.91, 0.99] Not estimable a 
Kruger 2020(a} 8 0 1 te] 0.89 [0.52, 1.00] Not estimable —_I- 
Kruger 2020{b} 2 0 1 0 0.67 [0.09, 0,99] Not estimable § —————————_ 
Kruger 2020{c) 18 0 0 0 1,00 [0,81, 1.00] Not estimable — 
Lambert-Niclot 2020 37 0 8 ie] 0,82 [0.68, 0,92] Not estimable + 
Liotti 2020 20 0 1 ie] 0,95 [0,76, 1,00] Not estimable — 
Mertens 2020 65 0 23 te] 0,74 [0.63, 0.83] Not estimable +s 
Nash 2020 48 0 5 te] 0,91 [0.79, 0.97] Not estimable + 
PHE 2020(a) 58 Oo 1 16] 0,98 [0,91, 1.00] Not estimable 4 
PHE 2020{b) 8 0: -@ ie] 1,00 [0,63, 1.00] Not estimable ——4 
PHE 2020{c} [non-HCW tested] 92 0 14 i¢] 0,87 [0.79, 0.93] Not estimable a all 
Porte 2020a 52 60 0 te] 1,00 [0.93, 1.00] Not estimable al 
Porte 2020b [A] 27 oO O i¢] 1,00 [0.87, 1.00] Not estimable — 
Porte 2020b [B] 27 oO O i¢] 1,00 [0.87, 1,00] Not estimable —- 
Scohy 2020 10 oO © ie] 1.00 [0.69, 1.00] Not estimable —4 
Takeda 2020 32 0 O 0 1,00 [0,89, 1.00] Not estimable —- 
Van der Moeren 2020(b} 62 6 32 te] 0.95 [0.87, 0.99] Not estimable + 
Veyrenche 2020 13 0 2 te] 0.87 [0.60, 0.98] Not estimable —_1- 
Weitzel 2020 [A] 45 0 8 i¢] 0,85 [0.72, 0.93] Not estimable + 
Weitzel 2020 [C] 11 #0 41 6] 0,21 [0.11, 0.35] Not estimable == 

Weitzel 2020 [D] 54 0 0 re) 1,00 [0.93, 1.00] Not estimable 
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Test 6. Antigen tests - Ct values >25 


Study TP FP FN TN Sensitivity (95% Cl) Specificity {95% Cl) Sensitivity (95% Cl)Specificity {95% Cl} 
Alemany 2020 315 O 73 QO 0,81 [0.77, 0.85] Not estimable al 
Fenollar 2020(a) 38 Oo 34 0 0.53 [0.41, 0.65] Not estimable —- 
Fenollar 2020{b} 9 O 12 0 0.43 (0,22, 0.66] Not estimable —_1— 
FIND 2020a 46 0 8 Oo 0.85 [0.73, 0.93] Not estimable Se 
FIND 2020b 16 0 15 90 0,52 [0,33, 0.70] Not estimable —— 
FIND 2020c (BR) 47 0 1060 9O 0,82 [0,70, 0,91] Not estimable —=—- 
FIND 2020c (CH) 34 0 17 #O 0.67 [0,52, 0,79] Not estimable — 
FIND 2020d (BR} 35 Oo 18 90 0.65 (0.51, 0.77] Not estimable + 
FIND 2020d (DE} 7 O 12 90 0.37 [0,16, 0,62] Not estimable —_—— 

FIND 2020e (BR} 37 O 25 O 0,60 [0,46, 0,72] Not estimable + 
FIND 2020e (DE} 1 0 9 90 0,10 [0,00, 0,45) Not estimable —#—— 

Fourati 2020 [A] 12 0148 O 0,07 [0,04, 0.13] Not estimable 

Fourati 2020 [B] 57 0103 O 0,36 [0,28, 0,44] Not estimable 7 

Fourati 2020 [C] 49 0112 90 0,30 [0,23, 0,38] Not estimable = 

Fourati 2020 [D] 55 0108 oO 0,34 [0.27, 0.42] Not estimable a 

Fourati 2020 [E] 56 0105 oO 0,35 [0.27, 0.43] Not estimable ae 

Kruger 2020{a} 2 0 6 oO 0.25 [0.03, 0.65] Not estimable ——#——— 
Kruger 2020{b} 2 =O 3 0 0.40 [0.05, 0.85] Not estimable ————#———— 
Kruger 2020{c} 18 Oo 11 0 0.62 [0.42, 0,79] Not estimable —— 
Lambert-Niclot 2020 10 OF 39 O 0,20 [0,10, 0,34] Not estimable —a— 

Liotti 2020 29 O 54 O 0,35 [0,25, 0.46] Not estimable + 
Mertens 2020 1l Oo 33 #O 0,25 [0,13, 0.40] Not estimable +, 

Nash 2020 32 0 15 O 0,68 [0.53, 0.81] Not estimable —+- 
PHE 2020{a} 37 O 82 O 0,31 [0.23, 0.40] Not estimable - 

PHE 2020{b} s 0 33 6 0,13 [0,04, 0,28] Not estimable —a— 

PHE 2020{c) [non-HCWtested]) 122 0 144 O 0,46 [0.40, 0,52] Not estimable all 

Porte 2020a 13° «0 5 @ 0,72 [0.47, 0,90] Not estimable —s— 
Porte 2020b [A] 3.°«¢0 2 #90 0,60 [0,15, 0,95] Not estimable =S—i— 
Porte 2020b [B] 2 Oo 3. ¢0 0,40 [0,05, 0,85] Not estimable §————2————_- 
Scohy 2020 22 0 74 O 0,23 [0.15, 0.33] Not estimable = 

Takeda 2020 18 0 12 O 0,60 [0.41, 0.77] Not estimable —— 
Van der Moeren 2020({b) 35 Oo 23 O 0.60 [0.47, 0.73] Not estimable — 
Veyrenche 2020 o Oo 30 O 0,00 [0,00, 0.12] Not estimable &— 

Weitzel 2020 [A] 4 0 22 0 0.15 [0,04, 0.35] Not estimable —#— 

Weitzel 2020 [C] 2 0 24 QO 0,08 [0,01, 0.25] Not estimable -— 

Weitzel 2020 [D] 14 0 #12 =O 0,54 [0,33, 0.73] Not estimable > 
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Test 7. Antigen tests - Ct values < or <=32/33 


Antigen tests - Ct values < or <=32/33 





Study TP FP FN TN Sensitivity (95% Cl} Specificity (95% Cl} Sensitivity (95% ClSpecificity (95% Cl} 

FIND 2020a 85 0 8 oO 0.91 [0.84, 0,96] Not estimable + 

FIND 2020b 104 GO #12 © 0,90 [0.83, 0,95] Not estimable al 

FIND 2020c (BR} Sl 0 8 oO 0,92 [0,.85, 0,96] Not estimable + 

FIND 2020c {CH} 168 oO 15 90 0,92 [0.87, 0,95] Not estimable Saad 

FIND 2020d (BR) 89 0 21 90 0.81 [0,72, 0,88) Not estimable ail 

FIND 2020d (DE) 27 0 S$ 90 0,75 [0.58, 0,88] Not estimable —- 

FIND 2020e {BR} 80 0 17 O 0,82 [0.73, 0,89] Not estimable + 

FIND 2020e (DE) 13° «0 8 O 0.62 [0.38, 0,82] Not estimable —— 

Fourati 2020 [A] 103 0139 90 0,43 [0.36, 0,49] Not estimable 

Fourati 2020 [B] 173 GO 68 O 0,72 (0.66, 0.77] Not estimable + 

Fourati 2020 [C] 161 OG 84 QO 0,66 [0.59, 0,72] Not estimable + 

Fourati 2020 [D] 174 0 #70 © 0.71 [0.65, 0.77] Not estimable * 

Fourati 2020 [E] 180 6 65 QO 0,73 [0.67, 0,79] Not estimable + 

Gremmels 2020(a} 101 O 5 oO 0.95 [0.89, 0,98] Not estimable 4 

Gremmels 2020(b) 48 0 1 oO 0.98 [0.89, 1.00] Not estimable ; = ; 
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Test 8. Antigen tests - Ct values >32/33 


Study TP FP FN TN Sensitivity {95% Cl) Specificity (95% Cl} Sensitivity (95% Cl}Specificity (95% CI} 
FIND 2020a 6 0 3 90 0.67 [0.30, 0.93] Not estimable — 
FIND 2020b 2 0 4 90 0,33 [0.04, 0.78] Not estimable §———#———— 
FIND 2020c (BR) 3.0 4 90 0,43 [0.10, 0.82] Not estimable § —————— 
FIND 2020c (CH) ae 6 © 0,25 [0.03, 0.65] Not estimable 

FIND 2020d (BR) 4 0 6 90 0,40 [0,12, 0,74] Not estimable 

FIND 2020d {DE} o Oo 3 90 0,00 [0,00, 0.71] Not estimable #——————_ 
FIND 2020e {BR} 7 O13 90 0,35 [0.15, 0,59] Not estimable 

FIND 2020e {DE} o Oo 4 90 0,00 [0,00, 0,60] Not estimable 

Fourati 2020 [A] oO 0 46 0 0,00 [0,.00, 0,08] Not estimable 

Fourati 2020 [B] 2 0 44 #O 0,04 [0.01, 0.15] Not estimable 

Fourati 2020 [C] 1 6 45 O 0,02 [0.00, 0,12] Not estimable 

Fourati 2020 [D] 2 0 46 O 0,04 [0,01, 0.14] Not estimable 

Fourati 2020 [E] 1 045 90 0,02 [0,00, 0,12] Not estimable 

Gremmels 2020{a} o oO 33 O 0,00 (0,00, 0,11) Not estimable 

Gremmels 2020{b} 3 011 #30 0.21 (0,05, 0,51) Not estimable 


= a 7 
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Test 9. Antigen tests - other Ct thresholds for 'higher' viral load 


Antigen tests - other Ct thresholds for ‘higher’ viral load 


Study TP FP FN TN Sensitivity (95% CI} Specificity (95% Cl} Sensitivity (95% Cl)Specificity (95% Cl} 
Alemany 2020 813 0 35 90 0,96 [0,94, 0,97] Not estimable a 
Diao 2020 55 oOo 1 0 0,98 [0,90, 1,00] Not estimable 41 
Fenollar 2020(a) 137 08 16 O 0.90 [0,.84, 0.94] Not estimable + 
Fenollar 2020(b) 9 0 2 0 0.82 [0.48, 0.98] Not estimable ——_1— 
Liotti 2020 43 0 33 O 0.57 [0.45, 0.68] Not estimable + 

Nash 2020 65 013 0 0,83 [0.73, 0,91] Not estimable + 
PHE 2020{a} 82 0 9 0 0.90 [0.82, 0,95] Not estimable al 
PHE 2020{b} 11 oO 1 0 0,92 [0.62, 1,00] Not estimable — 
PHE 2020(c}) [non-HCWtested]) 166 0 56 O 0,75 [0.69, 0,80] Not estimable 7 
Scohy 2020 24 #0 10 O 0.71 (0.53, 0,85] Not estimable ——- 
Takeda 2020 48 0 2 0 0.96 [0.86, 1.00] Not estimable aid 
Van der Moeren 2020(b) 92 0 7 0O 0.93 [0.86, 0.97] Not estimable + 
Veyrenche 2020 13 O17 O 0.43 [0.25, 0.63] Not estimable —— 


rN td 
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Test 10. Antigen tests - other Ct thresholds for 'lower' viral load 


Antigen tests - other Ct thresholds for ‘lower’ viral load 





Study TP FP FN TN Sensitivity (95% Cl} Specificity (95% Cl} Sensitivity (95% Cl}Specificity (95% Cl} 

Alemany 2020 59 0 44 @Q 0.57 [0.47, 0,67] Not estimable +a 

Diao 2020 86 0 66 O 0.57 [0.48, 0.65] Not estimable 

Fenollar 2020(a) 7 O 22 O 0.24 [0.10, 0.44] Not estimable 

Fenollar 2020(b} 1 © 10 O 0,09 [0,00, 0,41] Not estimable 

Liotti 2020 6 0 22 @Q 0,21 [0.08, 0.41] Not estimable 

Nash 2020 15 @ 7 0 0.68 [0.45, 0,86] Not estimable —— 

PHE 2020{a} 13 0 74 OQ 0.15 [0.08, 0.24] Not estimable 

PHE 2020({b} 2 0 32 QO 0.06 [0.01, 0.20] Not estimable 

PHE 2020(c} [non-HCW tested] 48 06 102 0 0.32 [0.25, 0.40] Not estimable 

Scohy 2020 68 Oo 64 OQ 0.11 [0,05, 0,21] Not estimable 

Takeda 2020 2 0 10 O 0.17 [0.02, 0.48] Not estimable 

Van der Moeren 2020{b) 5 0 19 O 0.21 [0.07, 0.42] Not estimable 

Veyrenche 2020 o Oo 15 0 0.00 [0.00, 0.22] Not estimable ' 
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Antigen tests - week 1 after symptom onset 


Test 11. Antigen tests - week 1 after symptom onset 





Study TP FP FN TN Sensitivity (95% CI} Specificity {95% Cl} Sensitivity (95% Cl)Specificity (95% Cl} 
Albert 2020 43 0 11 358 0,80 [0.66, 0.89] 1,00 [0.99, 1.00] ss a 
FIND 2020a 83 0 7 ie} 0,92 [0.85, 0.97] Not estimable +7 

FIND 2020b 95 0 16 ie) 0,86 [0.78, 0,92] Not estimable ll 

FIND 2020c {BR} 68 oO 9 18] 0,91 [0.83, 0.96] Not estimable + 

FIND 2020c {CH} 158 oO 18 8] 0,90 [0.84, 0,94] Not estimable = 

FIND 2020d (BR) 80 60 | |(20 18] 0,80 [0.71, 0.87] Not estimable + 

FIND 2020d (DE) 26 «0 6 18] 0.81 [0.64, 0.93] Not estimable — 

FIND 2020e (BR) 76 0 22 8] 0.78 [0.68, 0,85] Not estimable + 

FIND 2020e (DE) 100—=C«D 3 ie) 0.77 [0.46, 0,95] Not estimable —_- 

Fourati 2020 [A] $0 oO 109 ie} 0.45 [0.38, 0.52] Not estimable 7 

Fourati 2020 [B] 141 oO 58 ie} 0.71 [0.64, 0.77] Not estimable + 

Fourati 2020 [C] 131 0 69 ie) 0,66 [0.58, 0,72] Not estimable * 

Fourati 2020 [D] 137 O 63 ie) 0.69 [0.62, 0.75] Not estimable 7 

Fourati 2020 [E] 142 O 58 ie) 0,71 [0.64, 0.77] Not estimable 7 

Gremmels 2020(a) 75 O 26 846 0,74 [0.65, 0,82] 1,00 [1.00, 1.00] +s Lt 
Gupta 2020 49 0 8 134 0.86 [0.74, 0.94] 1,00 [0.97, 1.00] + a 
Kruger 2020(b} 3 40 4 ia] 0.43 [0.10, 0.82] Not estimable §=£—————— 

Kruger 2020({c)} 28 #7 7 907 0,80 [0.63, 0.92] 0,99 [0,98, 1.00] — a 
Linares 2020 32 O 5 846 0.86 [0.71, 0.95] 1,00 [1.00, 1.00] — a 
Nagura-lkeda 2020 7 O 41 te] 0.15 [0.06, 0,28] Not estimable —a— 

Porte 2020a 72 =O 4 42 0,95 [0.87, 0.99] 1,00 [0.92, 1.00] al 4 
Porte 2020b [A] 300=CL 2 31 0.94 [0.79, 0.99] 0.97 [0.84, 1.00] — — 
Porte 2020b [B] 29 #1 3 ‘31 0,91 [0.75, 0,98] 0,97 [0,84, 1,00] —- — 
Van der Moeren 2020(b} 59 0 7 ie] 0,89 [0.79, 0.96] Not estimable + 

Veyrenche 2020 9 1 13 31 0.41 [0.21, 0.64] 0.97 [0.84, 1.00] —_— — 
Young 2020 29 1 g 212 0.76 [0.60, 0,89] 1.00 [0.97, 1,00] 


Antigen tests - week 2 after symptom onset 


0020406081 


Test 12. Antigen tests - week 2 after symptom onset 


00.204060.8 1 


Study TP FP FN TN Sensitivity {95% CI} Specificity (95% Cl} Sensitivity (95% CI}Specificity (95% CI 
FIND 2020a 8 Oo 4 6] 0.67 [0,35, 0,90] Not estimable —*— 

FIND 2020b ll Oo 2 8] 0,85 [0,55, 0.98] Not estimable — 

FIND 2020c (BR} 6 Oo 3 0 0.67 [0,30, 0,93] Not estimable —— 

FIND 2020c¢ (CH} 12 0 3 0 0,80 [0,52, 0,96] Not estimable —_- 

FIND 2020d {BR} 13 0 7 6] 0.65 [0,41, 0,85] Not estimable —_— 

FIND 2020d (DE} 1 0 6 0 0.14 [0,00, 0.58] Not estimable —#——— 

FIND 2020e (BR} ll oO 8 0 0,58 [0,33, 0.80] Not estimable —_—*— 

FIND 2020e (DE} 3°40 #9$ 0] 0.25 [0,05, 0.57] Not estimable _——— 

Fourati 2020 [A] 13° 40 73 ie] 0.15 [0,08, 0.24] Not estimable — 

Fourati 2020 [B] 32 0 53 ¢] 0,38 [0,27, 0.49] Not estimable + 

Fourati 2020 [C] 30460 57 6] 0,34 [0,25, 0.45] Not estimable + 

Fourati 2020 [D] 38 O 51 18] 0,43 [0,32, 0.54] Not estimable + 

Fourati 2020 [E] 36 0 51 8] 0,41 [0,31, 0.52] Not estimable +a 

Gremmels 2020(a) 5 0 5 181 0.50 [0,19, 0.81] 1.00 [0,98, 1.00] —— Ll 
Gupta 2020 5 Oo 2 5 0.71 [0,29, 0.96] 1,00 [0.48, 1.00] ——— ——4 
Kruger 2020(b} 160 0 96 1.00 [0,03, 1,00] Not estimable ———————————8 

Kruger 2020{c} 4 0 0 54 1,00 [0.40, 1.00] 1,00 [0.93, 1.00] ——4 41 
Linares 2020 7 Oo 6 6] 0,54 [0,25, 0.81] Not estimable —— 

Nagura-Ikeda 2020 3.0 37 o 0,07 [0.02, 0,20] Not estimable —#— 

Porte 2020a 4 0 1 3 0,80 [0,28, 0,99] 1,00 [0,29, 1.00] ——— ——4 
Van der Moeren 2020{b}) 38 oO 19 oO 0.67 [0,53, 0.79] Not estimable ae 

Veyrenche 2020 4 0 10 ie] 0.29 [0,08, 0.58] Not estimable } = 
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Molecular tests - all 


Study 
Assennato 2020 
Broder 2020 
Chen 2020a 
Collier 2020 
Cradic 2020(a) 
Cradic 2020(b} 
Dust 2020 
Ghofrani 2020 
Gibani 2020 
Goldenberger 2020 
Harrington 2020 
Hogan 2020 
Hou 2020 

jin 2020 

Jokela 2020 
Lephart 2020 [A] 
Lephart 2020 [B] 
Lieberman 2020 
Loeffelholz 2020 
Mitchell 2020 
Moore 2020 
Moran 2020 
Rhoads 2020 
Smithgall 2020 [A] 
Smithgall 2020 [B] 
SoRelle 2020 
Stevens 2020 
Thwe 2020 
Wolters 2020 
Wong 2020 
Zhen 2020 [A] 
Zhen 2020 [B] 


TN Sensitivity (95% Cl} Specificity (95% Cl} Sensitivity (95% Cl)Specificity (95% Cl) 


TP FP FN 
87 3 1 81 
34 0 1 «0 
55 0 0 0 
29 3 42113 
30 0 3 151 
12 0 1 169 
20 0 oO 18 
16 1 1 95 
67 Oo 4 315 
10 0 0 9 

139 2 47 336 
34 0 16 50 

147 5 6 127 

4 0 2 46 
60 0 O 30 
ll o 5 59 
16 2 0 56 
130 0 13 

219 11 1 250 
33 013 15 
94 0 25 79 
42 1 0 60 
99 0 6 O 
65 0 23 25 
87 2 1 23 
32.0 7 44 
53 0 1 50 

8 Oo 6 147 
58 0 0 30 

118 0 1 43 
50 0 7 50 
57 0 1 50 


Test 13. Molecular tests - all 


0.99 [0.94, 1.00] 
0.97 [0.85, 1.00] 
1.00 [0.94, 1.00) 
0.88 [0.72, 0.97] 
0.91 [0.76, 0.98] 
0,92 [0.64, 1.00] 
1.00 [0.83, 1.00] 
0.94 [0.71, 1.00] 
0,94 [0,86, 0.98] 
1,00 [0,69, 1,00] 
0.75 [0.68, 0,81) 
0.68 [0.53, 0.80] 
0.96 [0.92, 0.99] 
0.67 [0.22, 0.96] 
1.00 [0.94, 1.00] 
0.69 [0.41, 0.89] 
1,00 [0.79, 1.00] 
1.00 [0.75, 1.00] 
1,00 [0.97, 1.00] 
0.72 [0.57, 0,84] 
0.79 [0,71, 0,86] 
1,00 [0,92, 1,00] 
0,94 [0.87, 0.98] 
0.74 [0.63, 0.83] 
0.99 [0.94, 1.00] 
0.82 [0.66, 0.92] 
0.98 [0.90, 1.00) 
0.57 [0.29, 0.82] 
1.00 [0.94, 1.00] 
0,99 [0.95, 1.00] 
0,88 [0.76, 0.95] 
0,98 [0,91, 1,00] 


0,96 [0,90, 0,99] 
Not estimable 
Not estimable 

0.97 [0,93, 0,99] 

1,00 [0.98, 1.00] 

1.00 [0,98, 1.00] 

1.00 [0.81, 1.00] 

0.99 [0,94, 1.00] 

1.00 [0.99, 1.00] 

1.00 [0.66, 1.00] 

0,99 [0,98, 1,00] 

1,00 [0,93, 1.00] 

0,96 [0,91, 0,99] 

1,00 [0,92, 1.00] 

1,00 [0.88, 1.00] 

1,00 [0.94, 1.00] 

0.97 [0,88, 1.00] 

1.00 [0.75, 1.00] 

0.96 [0.93, 0.98] 

1.00 [0.78, 1.00] 

1.00 [0.95, 1.00] 

0,98 [0,91, 1.00] 
Not estimable 

1,00 [0,86, 1,00] 

0,92 [0.74, 0,99] 

1,00 [0.92, 1.00] 

1,00 [0.93, 1.00] 

1,00 [0,98, 1.00] 

1,00 [0.88, 1.00] 

1,00 [0,92, 1.00] 

1,00 [0.93, 1.00] 

1,00 [0,93, 1.00] 


sh eadeaatl iteltcietes colaas a 


ae eee 
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Test 14. Molecular tests - all (before discrepant analysis) 


Molecular tests - all {before discrepant analysis} 


Study 
Assennato 2020 
Collier 2020 
Harrington 2020 
Loeffelholz 2020 
Moran 2020 
Stevens 2020 


FP FN TN Sensitivity (95% Cl} Specificity (95% CI} Sensitivity (95% Cl)Specificity (95% CI} 


TP 
87 3 1 281 
29 3 #4113 

139 2 47 336 

219 11 1 250 
42 1 0 60 
53 0 1 50 


0.99 [0.94, 1.00) 
0.88 [0,72, 0.97) 
0.75 [0.68, 0.81] 
1.00 [0.97, 1.00) 
1,00 [0,.92, 1.00) 
0,98 [0.90, 1.00) 


0.96 [0.90, 0.99] 
0.97 [0.93, 0.99] 
0.99 [0.98, 1.00) 
0.96 [0.93, 0.98) 
0.98 [0.91, 1.00] 


a + 
—- a 
+ a 

| a 

41 


1,00 [0.93, 1.00) | a 4 er i, 
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Test 15. Molecular tests - all (after discrepant analysis) 


Study TP FP FN TN Sensitivity (95% CI} Specificity (95% Cl} Sensitivity (95% Cl)Specificity (95% CI} 
Assennato 2020 so 0 1 281 0,99 [0.94, 1.00] 1.00 [0.96, 1.00] a a 
Collier 2020 31 1 1 £116 0.97 [0,84, 1.00] 0.99 [0,95, 1.00] — a 
Harrington 2020 140 QO 47 337 0.75 [0.68, 0.81] 1.00 [0.99, 1,00) all a 
Loeffelholz 2020 227) 63) «=6© 8 251 1,00 [0,98, 1.00] 0.99 [0.97, 1.00] Ld a 
Moran 2020 42 0 0 61 1,00 [0,92, 1.00] 1,00 [0.94, 1.00) 4 +1 
Stevens 2020 53.0 0 51 1,00 [0,93, 1.00] 1,00 [0,93, 1.00) 


Molecular tests - Ct values < or <=30 


0020406081 002040.60.8 1 


Test 16. Molecular tests - Ct values < or <=30 


Study TP FP FN TN Sensitivity (95% Cl} Specificity (95% Cl} Sensitivity (95% CI)Specificity (95% Cl} 
Jokela 2020 53 0 0 OO 1,00 [0.93, 1.00) Not estimable 4 
Lieberman 2020 6 oOo Oo O 1.00 [0.54, 1.00) Not estimable —4 
Mitchell 2020 15 0 0 @ 1,00 [0,78, 1.00) Not estimable — 
Smithgall 2020 [4] 53 0 OO O 1,00 [0,93, 1,00) Not estimable 4 
Smithgall 2020 [B] 53.0 0 0 1,00 [0,93, 1.00] Not estimable 4 
Wolters 2020 24 0 O 0 1,00 [0,86, 1,00) Not estimable }—_+_4 —- } }—4 


0020406081 00204060.8 1 


Test 17. Molecular tests - Ct values >30 


Molecular tests - Ct values >30 


Study TP FP FN TN Sensitivity (95% Cl) Specificity (95% Cl} Sensitivity (95% Ci)Specificity (95% Cl} 
Jokela 2020 7 O GO O 1,00 [0.59, 1.00) Not estimable — 

Lieberman 2020 7 O GD O 1.00 [0.59, 1.00) Not estimable ——4 

Mitchell 2020 18 O13 @ 0.58 [0.39, 0.75] Not estimable —i— 

Smithgall 2020 [A] 12 0 23 O 0.34 [0.19, 0.52] Not estimable —— 

Smithgall 2020 [B] 34° 0 #1 =O 0,97 [0,85, 1.00] Not estimable = 

Wolters 2020 340 #0 0 1,00 [0,90, 1.00] Not estimable 


Molecular tests - other Ct thresholds for ‘higher' viral load 


bt — 
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Test 18. Molecular tests - other Ct thresholds for 'higher' viral load 


Study TP FP FN TN Sensitivity {95% CI} Specificity (95% Cl} Sensitivity (95% Cl)Specificity (95% Cl} 
Lieberman 2020 10 60 90 1.00 [0,.03, 1.00) Not estimable ———————————8 
Smithgall 2020 [A] 15 0 O O 1,00 [0.78, 1.00] Not estimable —1 
Smithgall 2020 [B}] 15 oO oO O 1,00 [0.78, 1.00) Not estimable — 
Stevens 2020 44 0 0 90 1,00 [0,92, 1.00] Not estimable }—4+ 4 + } +4 
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Test 19. Molecular tests - other Ct thresholds for 'lower' viral load 


Study TP FP FN TN Sensitivity (95% Cl} Specificity (95% CI} Sensitivity (95% Cl)Specificity (95% Cl} 

Lieberman 2020 12 0 0 906 1.00 [0.74, 1.00) Not estimable — 

Smithgall 2020 [A] 50 0 23 OQ 0,68 [0.57, 0.79] Not estimable + 

Smithgall 2020 [B] 72 #O 1 ie) 0,99 [0,93, 1.00] Not estimable a 

Stevens 2020 § Oo 1 90 0,90 [0.55, 1.00] Not estimable +4 ny } +4 

0020406081 0020406081 

Test 20. Molecular tests - other sites 

Molecular tests - other sites 

Study TP FP FN TN Sensitivity (95% Cl} Specificity (95% Cl} Sensitivity (95% CI)Specificity (95% CI} 

Chen 2020a 49 0 6 ie) 0,89 [0,78, 0,96] Not estimable + 

Cradic 2020(b) 12 O 1 169 0,92 [0.64, 1.00] 1,00 [0.98, 1.00] — a 

Szymezak 2020 27 2 2 48 0,93 [0.77, 0,99] 0,96 [0.86, 1.00] Ty 


Antigen tests - direct comparisons 


—ta-ala ateatooa! ++ +4 Sj 
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Test 21. Antigen tests - direct comparisons 


Study TP FP FN TN Sensitivity (95% Cl} Specificity (95% Cl} Sensitivity (95% Cl}Specificity (95% CI} 
Fourati 2020 [A] 103 0 189 337 0.35 [0.30, 0.41] 1,00 [0.99, 1.00] 7 a 
Fourati 2020 [B] 175 23 116 314 0.60 [0.54, 0.66] 0,93 [0.90, 0.96] nal a 
Fourati 2020 [C] 163 0 132 3357 0,55 [0.49, 0.61] 1,00 [0.99, 1.00] = Lt 
Fourati 2020 [D] 177 O 120 337 0,60 [0.54, 0.65] 1,00 [0.99, 1.00] * Ls 
Fourati 2020 [E] 182 0 113 337 0.62 [0.56, 0.67] 1,00 [0.99, 1.00] = a 
Porte 2020b [A] 30 #1 2 31 0,94 [0.79, 0.99] 0,97 [0.84, 1.00] — — 
Porte 2020b [B] 29 #1 3 431 0,91 [0.75, 0.98] 0,97 [0.84, 1.00] — — 
Weitzel 2020 [A] 49 0 30 30 0.62 [0.50, 0.73] 1,00 [0.88, 1.00] —= —- 
Weitzel 2020 [B] oul 9 9 0,00 [0.00, 0.34] 0,90 [0.55, 1.00) #—— — 
Weitzel 2020 [C] 13 Oo 65 31 0.17 [0.09, 0.27] 1,00 [0.89, 1.00] 7 

Weitzel 2020 [D] 68 0 12 31 0,85 [0.75, 0.92] 


1.00 [0.89, 1.00] | } arin +4 } - 
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Test 22. AAZ - COVID-VIRO (CGIA) 


AAZ - COVID-VIRO {CGIA} 


Study TP FP FN TN Sensitivity (95% Cl} Specificity (95% Cl} Sensitivity (95% onan, ea ch 
Courtellemont 2020 97 20 4 127 0.96 [0.90, 0.99] 0.86 [0.80, 0.91] 
Fourati 2020 [E] 182 0 113 337 0.62 (0.56, 0.67] 1,00 [0.99, 1.00] +4 Sal } Ly 
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Test 23. Abbott - Panbio Covid-19 Ag (CGIA) 


Abbott - Panbio Covid-19 Ag (CGIA)} 


Study 

Albert 2020 
Alemany 2020 
Billaud 2020 
Fenollar 2020{a} 
Fenollar 2020{b} 
FIND 2020b 
Fourati 2020 [C] 
Gremmels 2020{a} 
Gremmels 2020(b} 
Linares 2020 
Schildgen 2020 [B] 


TP 
43 
B72 
53 
144 
10 
106 
163 
101 
Sl 
44 
21 


FP 


wooooonouua 


TN Sensitivity (95% Cl) Specificity (95% Cl) Sensitivity {95% Cl)Specificity {95% Cl} 


358 
450 
358 
ie] 
130 
411 
337 
1228 
145 
195 
24 


0,80 [0.66, 0,89] 
0,92 [0.90, 0.93] 
0,54 [0.43, 0.64] 
0.79 [0.72, 0,85] 
0.45 [0.24, 0.68] 
0,85 [0.78, 0.91] 
0.55 [0.49, 0.61] 
0.73 [0.64, 0,80] 
0.81 [0.69, 0.90] 
0.73 [0.60, 0.84] 
0.50 [0.34, 0.66] 


1,00 [0.99, 1,00] 
0.99 [0.97, 1.00] 
0,99 [0.97, 1.00] 

Not estimable 
0.95 [0.90, 0.98] 
1,00 [0.99, 1.00] 
1.00 [0.99, 1.00] 
1,00 [1.00, 1.00] 
1.00 [0.97, 1.00] 
1.00 [0.98, 1.00] 
0.77 [0.59, 0.90] 


—- a 

a a 

+ a 
+ 

—_i—- | 

- a 

- a 

+ a 

—- a 

— a 


—— a a a 
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Test 24. Becton Dickinson - BD Veritor (LFA - method not specified) 


Becton Dickinson - BD Veritor (LFA - method not specified} 


Study 


T 


FP FN TN Sensitivity (95% Cl} Specificity (95% Cl} Sensitivity (95% Cl}Specificity (95% CI} 


Van der Moeren 2020{a) 16 2 1 332 0,94 [0.71, 1.00] 0,99 [0.98, 1.00] — a 
Van der Moeren 2020(b}) 98 O 27 te] 0.78 [0.70, 0.85] Not estimable + 
Young 2020 29 #1 9 212 0.76 [0.60, 0,89] 1,00 [0.97, 1.00] } = 
0020406081 0020406081 
Test 25. BIONOTE - NowCheck COVID-19 Ag (LFA - method not specified) 


BIONOTE - NowCheck COVID-19 Ag (LFA - method not specified} 


Study 
FIND 2020a 


TP FP FN TN Sensitivity (95% Cl) Specificity (95% CI) Sensitivity (95% CI)Specificity (95% CI) 
91 8 11 290 0.89 [0.92, 0,94] 0.97 [0.95, 0.99] =a 4 
bozoaotsoel bozoaoeoel 


Test 26. Biosynex - Biosynex COVID-19 Ag BSS (CGIA) 


Biosynex - Biosynex COVID-19 Ag BSS {CGIA} 


Study 
Fourati 2020 [D] 


TP FP FN TN Sensitivity (95% Cl} Specificity (95% Cl} Sensitivity (95% ClSpecificity (95% CI} 
177 O 120 337 0.60 [0.54, 0.65] 1.00 [0.99, 1.00] 4 + } 4 } Ly 
0020406081 0020406081 


Test 27. Coris Bioconcept - COVID-19 Ag Respi-Strip (CGIA) 


Coris Bioconcept - COVID-19 Ag Respi-Strip (CGIA)} 


Study TP FP FN TN Sensitivity (95% CI} Specificity (95% Cl} Sensitivity (95% ClSpecificity (95% CI} 
Blairon 2020 9 0 21 26 0,30 [0.15, 0,49] 1,00 [0.87, 1.00] —i— — 
Fourati 2020 [A] 103 O 189 337 0.35 [0.30, 0,41] 1,00 [0.99, 1,00] oll Ld 
Kruger 2020(b} 4 17 4 392 0,50 [0.16, 0,84] 0.96 [0.93, 0.98] —— L 
Lambert-Niclot 2020 47) 0 47 44 0,50 [0.40, 0,60] 1,00 [0,92, 1,00] +s 4 
Mertens 2020 76 1 56 195 0.58 [0.49, 0,66] 0,99 [0.97, 1,00] +a LJ 
Scohy 2020 32 0 74 42 0,30 [0,22, 0.40] 1.00 [0,92, 1.00] a 41 
Veyrenche 2020 1390 32 20 0,29 [0.16, 0,44] 1,00 [0,83, 1.00] Ft 
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Test 28. E25Bio - DART (NP) (CGIA) 





E25Bio - DART {NP} {CGIA} 


Study TP FP FN TN Sensitivity (95% Cl} Specificity (95% Cl} Sensitivity (95% Cl}Specificity (95% Cl} 
Nash 2020 80 8 20 82 0,80 [0,71, 0,87] 0,91 [0,83, 0,96] if 
0020406081 0020406081 


Test 29. Fujirebio - ESPLINE SARS-CoV-2 [LFA(ALP)] 


Fujirebio - ESPLINE SARS-Co¥-2 [LFA{ALP}] 


Study TP FP FN TN Sensitivity (95% Cl) Specificity (95% Cl} Sensitivity (95% Cl}Specificity (95% Cl) 
Nagura-lkeda 2020 12 O 91 te] 0.12 [0.06, 0.19] Not estimable 


Takeda 2020 50 0 12 100 0,81 [0.69, 0,90) 1,00 [0.96, 1.00] } == } # 


0020406081 0020.4060.8 1 


Test 30. Inhouse (Bioeasy co-author) - n/a (FIA) 


Inhouse (Bioeasy co-author) - n/a (FIA) 
Study TP FP FN TN Sensitivity (95% Cl) Specificity (95% Cl} Sensitivity (95% Cl)Specificity (95% Cl} 


Diao 2020 141 O 67 31 0.68 [0.61, 0.74] 1,00 [0.89, 1.00] aa 
0020406081 002040608 1 


Test 31. Innova Medical Group - Innova SARS-CoV-2 Ag (CGIA) 


Innova Medical Group - Innova SARS-Co¥V-2 Ag {CGIA)} 


Study TP FP FN~ TN Sensitivity (95% Cl} Specificity (95% Cl} Sensitivity (95% Cl)Specificity (95% CI} 
PHE 2020{a) 95 0 83 940 0.53 [0.46, 0.61] 1.00 [1.00, 1.00] 7 Ld 
PHE 2020({b) 13 0 33 105 0,28 [0.16, 0,43] 1,00 [0.97, 1,00]  —#— =i 
PHE 2020(c} [non-HCWtested]) 214 5 158 1299 0.58 [0.52, 0.63] 1.00 [0.99, 1.00] nal Ld 
PHE 2020(d) [HCW tested] 156 0 67 0 0,70 [0.63, 0.76] Not estimable 7 

PHE 2020(d) [Lab tested] 156 0 42 i¢] 0.79 [0.72, 0,84] Not estimable all 

PHE 2020{e} ool 0 537 Not estimable 1,00 [0.99, 1.00] 


p+} ++ 4 | 4 + 4 FF 
oo 20406081 0020406081 


Test 32. Liming Bio-Products - StrongStep® COVID-19 Ag (CGIA) 


Liming Bio-Products - StrongStep® COVID-19 Ag (CGIA} 
Study TP FP FN TN Sensitivity {95% CI) Specificity (95% Cl) Sensitivity (95% Cl}Specificity (95% CI} 


Weitzel 2020 [B] ool $8 § 0,00 [0,00, 0.34] 0.90 [0.55, 1.00] —=—— }—4 } 4+ 4 | 
0020406081 0020406081 


Test 33. Quidel Corporation - SOFIA SARS Antigen (FIA) 


Quidel Corporation - SOFIA SARS Antigen {FIA} 


Study TP FP FN TN Sensitivity {95% Cl} Specificity (95% Cl} Sensitivity (95% Cl)Specificity (95% CI} 


Porte 2020b [A] 30 1 2 31 0,94 [0,79, 0,99] 0.97 [0.84, 1.00] } +—4 cs } +4 
0020406081 0020406081 
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Test 34. RapiGEN - BIOCREDIT COVID-19 Ag (CGIA) 


RapiGEN - BIOCREDIT COVID-19 Ag (CGIA} 


Study TP FP FN~ TN Sensitivity {95% Cl} Specificity (95% Cl} Sensitivity (95% ClSpecificity (95% CI} 
FIND 2020e (BR} 87 4 30 355 0.74 [0.65, 0,82] 0,99 [0,97, 1.00] a Ld 
FIND 2020e (DE} 13° 0 12 1214 0.52 [0.31, 0.72] 1.00 [1.00, 1.00] — i Ld 
Mak 2020 Sl oO 109 16] 0,32 [0,25, 0.40] Not estimable > 

Schildgen 2020 [4] 14 4 28 27 0.33 [0.20, 0.50] 0.87 [0.70, 0.96] —_ ne 
Shrestha 2020 40 0 7 66 0.85 [0,72, 0.94] 1,00 [0,.95, 1.00] + 4 
Weitzel 2020 [A] 49 0 


30 30 0.62 [0.50, 0.73] 1.00 [0.88, 1.00] } = 


0020406081 0020406081 


Test 35. Roche - SARS-CoV-2 (LFA - method not specified) 


Roche - SARS-Co¥-2 (LFA - method not specified} 
Study TP FP FN TN Sensitivity (95% Cl} Specificity (95% Cl) Sensitivity (95% Cl)Specificity (95% Cl} 


Schildgen 2020 [C] 37 25 5 6 0.88 [0.74, 0,96] 0.19 [0,07, 0.37) } oa =. | 
0020406081 0020.40.60.8 1 


Test 36. Savant Biotech - Huaketai SARS-CoV-2 N Protein (LFA - method not specified) 


Savant Biotech - Huaketai SARS-CoV-2 N Protein {LFA - method not specified) 


Study TP FP FN TN Sensitivity (95% CI} Specificity (95% CI} Sensitivity (95% Cl}Specificity (95% CI} 
Weitzel 2020 [C] 13 0 65 31 0.17 [0,09, 0,27] 1.00 [0.89, 1,00] 
00.20.406081 002040608 1 


Test 37. SD Biosensor - STANDARD F COVID-19 Ag (FIA) 


SD Biosensor - STANDARD F COVID-19 Ag (FIA) 


Study TP FP FN TN Sensitivity (95% Cl} Specificity (95% CI} Sensitivity (95% Cl)Specificity (95% Cl} 
FIND 2020d {BR} 93 7 27 326 0.78 [0,69, 0.85] 0,98 [0,96, 0.99] +a Ld 
FIND 2020d(DE} 27 20 12 617 0.69 [0,52, 0,83] 0.97 [0.95, 0.98] — = 
Liotti 2020 49 4 55 251 0,47 [0.37, 0.57] 0,98 [0,96, 1.00] + a 
Porte 2020b [B] 29 1 3 #31 0.91 [0.75, 0.98] 0.97 [0,84, 1.00] arial 


a 
0020406081 0020406081 


Test 38. SD Biosensor - STANDARD Q COVID-19 Ag (CGIA) 


SD Biosensor - STANDARD Q COVID-19 Ag (CGIA)} 


Study TP FP FN~ TN Sensitivity (95% Cl} Specificity (95% Cl} Sensitivity {95% Cl)Specificity (95% Cl} 
Cerutti 2020 77 GO 32 221 0.71 [0.61, 0,79] 1,00 [0,98, 1,00] +a LJ 
FIND 2020c {BR} 94 7 12 287 0.89 [0,81, 0,94] 0.98 [0,95, 0,99] mal a 
FIND 2020c(CH} 170 1 21 337 0.89 [0,84, 0,93] 1.00 [0,98, 1,00] nal Ld 
Fourati 2020 [B] 175 23 116 314 0.60 [0.54, 0,66] 0.93 [0,90, 0,96] al a 
Gupta 2020 63 1 14 252 0,82 [0,71, 0,90] 1.00 [0,98, 1,00] + La 
Kruger 2020(c} 36 $ 11 1207 0.77 [0.62, 0.88) 0,99 [0,99, 1.00] 
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Test 39. Shenzhen Bioeasy Biotech - 2019-nCoV Ag (FIA) 


Shenzhen Bioeasy Biotech - 2019-nCoV Ag {FIA} 


Study TP FP FN TN Sensitivity (95% Cl} Specificity (95% Cl} Sensitivity (95% Cl}Specificity (95% Cl} 
Kruger 2020(a} 10 49 5 663 0.67 [0.38, 0.88] 0.93 [0.91, 0,95] —i— LJ 
Porte 2020a 77 OF 5 45 0,94 [0,86, 0,98] 1.00 [0,92, 1,00] + 4 
Weitzel 2020 [D] 68 0 12 31 0,85 [0,75, 0.92] 1.00 [0,89, 1.00] arial 


0020406081 0020406081 


Test 40. Abbott - ID NOW (Isothermal PCR) 


Abbott - ID NOW {Isothermal PCR} 


Study TP FP FN TN Sensitivity (95% Cl} Specificity (95% Cl} Sensitivity (95% Cl}Specificity (95% CI} 
Cradic 2020{a) 30 O 3 151 0,91 [0.76, 0.98] 1,00 [0.98, 1,00] — a 
Cradic 2020{b) 12 oO 1 169 0,92 [0.64, 1.00] 1,00 [0.98, 1.00] — a 
Ghofrani 2020 16 1 1 $5 0,94 [0.71, 1.00] 0.99 [0.94, 1,00] —t a 
Harrington 2020 139 2 47 336 0,75 [0.68, 0.81] 0,99 [0.98, 1,00] * Lt 
Jin 2020 4 0 2 46 0.67 [0.22, 0,96] 1,00 [0,92, 1,00] ——— +41 
Lephart 2020 [A] ll oO 5 59 0.69 [0.41, 0.89] 1,00 [0.94, 1.00] —— 4a 
Mitchell 2020 33.4013 #15 0,72 [0.57, 0.84] 1,00 [0.78, 1.00] —- —1 
Moore 2020 $4 0 25 79 0,79 [0.71, 0.86] 1,00 [0.95, 1.00] +. a 
Rhoads 2020 $0 0 6 0 0,94 [0.87, 0,98] Not estimable all 

Smithgall 2020 [A] 65 0 23 25 0.74 [0.63, 0.83] 1,00 [0.86, 1.00] + — 
SoRelle 2020 32 0 F 44 0,82 [0.66, 0,92] 1,00 [0.92, 1,00] — +41 
Thwe 2020 8 OO 6 147 0,57 [0.29, 0,82] 1,00 [0.98, 1,00] —— . 
Zhen 2020 [A] 50 oO 7 50 0,88 [0.76, 0,95] 1,00 [0.93, 1,00] 


+++ Fy p+ + + 4 Ft 


0020406081 0020406081 


Test 41. Cepheid - Xpert Xpress (Automated RT-PCR) 


Cepheid - Xpert Xpress (Automated RT-PCR} 


Study TP FP FN TN Sensitivity (95% Cl} Specificity (95% Cl} Sensitivity (95% Cl)Specificity (95% Cl} 
Broder 2020 34 #0 1 ie) 0,97 [0.85, 1.00] Not estimable —- 

Chen 2020a so 6G )~=|6G ie) 1,00 [0,94, 1.00] Not estimable 4 

Dust 2020 20 0 O 18 1,00 [0.83, 1.00] 1,00 [0,81, 1,00] —1 —1 
Goldenberger 2020 10 oO 9 3 1,00 [0.69, 1.00] 1.00 [0.66, 1.00] ——4 —« 
Hou 2020 147 5S 6 127 0,96 [0,92, 0.99] 0.96 [0,91, 0.99] a a 
Jokela 2020 60 Oo OO 30 1,00 [0,94, 1.00] 1,00 [0.88, 1.00] + — 
Lephart 2020 [B] 16 2 #0 56 1,00 [0.79, 1.00] 0.97 [0.88, 1.00] —1 1 
Lieberman 2020 pc 6 a © | 1,00 [0,75, 1,00] 1,00 [0,75, 1,00] —1i —4 
Loeffelholz 2020 219 11 #=1 250 1,00 [0,97, 1.00] 0,96 [0,93, 0,98] a a 
Moran 2020 42 1 0 60 1,00 [0,92, 1.00] 0,98 [0,91, 1.00] +41 4 
Smithgall 2020 [B] 87 2 1 23 0.99 [0,.94, 1.00] 0,92 [0.74, 0.99] a — 
Stevens 2020 53 Oo 1 50 0,98 [0.90, 1.00] 1,00 [0,93, 1,00] +41 4 
Wolters 2020 58 oO OO 30 1,00 [0,94, 1.00] 1,00 [0.88, 1.00] a — 
Wong 2020 118 oO 1 43 0,99 [0.95, 1.00] 1.00 [0,92, 1.00] a 41 
Zhen 2020 [B] 57 oO 1 50 0,98 [0,91, 1.00] 1,00 [0.93, 1.00] 


0020406081 0020406081 


Test 42. DNANudge - COVID Nudge (Automated RT-PCR) 


DNANudge - COVID Nudge {Automated RT-PCR} 


Study 


TP FP FN TN Sensitivity (95% Cl) Specificity (95% Cl) Sensitivity (95% Cl)Specificity (95% CI} 





Gibani2020 67 GO 4 315 0,94 [0.86, 0.98] 


1.00 [0.99, 1.00] a es 
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Test 43. DRW - SAMBAII (Automated RT-PCR) 


DRW - SAMBA II (Automated RT-PCR) 


Study 
Assennato 2020 87 3 1 81 
Collier 2020 29 3 4113 


0.96 [0.90, 0,99] 


0,97 [0,93, 0,99] } = a= } } * 


Cochrane Database of Systematic Reviews 


TP FP FN TN Sensitivity (95% CI} Specificity (95% Cl} Sensitivity (95% Cl)Specificity (95% 
0.99 [0,94, 1.00] 
0,88 [0,72, 0.97] 


0020406081 0020406081 


Test 44. Mesa Biotech - Accula (other molecular) 


Mesa Biotech - Accula (other molecular} 


Study 
Hogan 2020 34 


0 16 50 


1,00 [0,.93, 1,00] 


TP FP FN TN Sensitivity {95% Cl} Specificity (95% Cl} Sensitivity (95% Cl)Specificity (95% Cl} 
0,68 [0,53, 0,80) 


—_— 


}—+ + + _,_—# 


koe SH 
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Test 45. Antigen test evaluations - Single group design 


Antigen test evaluations - Single group design 


Study 

Albert 2020 
Alemany 2020 
Billaud 2020 

Blairon 2020 

Cerutti 2020 

Diao 2020 

FIND 2020a 

FIND 2020b 

FIND 2020c (BR) 
FIND 2020c (CH) 
FIND 2020d (BR} 
FIND 2020d (DE} 
FIND 2020e (BR} 
FIND 2020e (DE} 
Gremmels 2020{a)} 
Gremmels 2020(b} 
Gupta 2020 

Kruger 2020(a) 
Kruger 2020(b) 
Kruger 2020(c) 
Lambert-Niclot 2020 
Linares 2020 
Mertens 2020 

PHE 2020(b} 

PHE 2020{c} [non-HCW tested] 
Scohy 2020 
Shrestha 2020 

Van der Moeren 2020(a} 
Young 2020 


TP FP 
43 
872 
53 
9 
77 
141 
91 
106 


La oa 
oa e 
PL 
PNOOUOrF OO OW OrooobhOoONrP HN OoOMooOoOUUue 


TN Sensitivity (95% CI} Specificity (95% Cl) Sensitivity (95% Cl}Specificity (95% CI} 


358 
450 
358 
26 
221 
31 
290 
411 
287 
337 
326 
617 
355 
1214 
1228 
145 
252 
663 
392 
1207 
44 
195 
195 
105 
1299 
42 
66 
332 
212 


0.80 [0.66, 0.89] 
0.92 [0.90, 0,93] 
0.54 [0.43, 0.64] 
0.30 [0.15, 0,49] 
0.71 [0.61, 0.79] 
0.68 [0.61, 0.74] 
0.89 [0.82, 0.94] 
0.85 [0.78, 0.91] 
0.89 [0.81, 0,94] 
0.89 [0.84, 0.93] 
0.78 [0.69, 0,85] 
0.69 [0.52, 0.83] 
0.74 [0.65, 0.82] 
0.52 [0.31, 0.72] 
0.73 [0.64, 0.90] 
0.81 [0.69, 0,90] 
0.82 [0.71, 0.90] 
0.67 [0.38, 0.88] 
0.50 [0.16, 0.84] 
0.77 [0.62, 0.88] 
0,50 [0.40, 0.60] 
0.73 [0.60, 0.94] 
0.58 [0.49, 0,66] 
0.28 [0.16, 0.43] 
0.58 [0.52, 0,63] 
0.30 [0.22, 0.40] 
0.85 [0.72, 0.94] 
0.94 [0.71, 1.00] 
0.76 [0.60, 0.89] 


1.00 [0.99, 1.00] 
0.99 [0.97, 1.00] 
0.99 [0.97, 1.00] 
1,00 [0.87, 1.00] 
1.00 [0.98, 1.00] 
1.00 [0.89, 1.00] 
0.97 [0.95, 0,99] 
1.00 [0.99, 1.00] 
0.98 [0.95, 0,99] 
1.00 [0.98, 1.00] 
0.98 [0.96, 0,99] 
0.97 [0.95, 0.98] 
0.99 [0.97, 1.00] 
1.00 [1.00, 1.00] 
1.00 [1.00, 1.00] 
1,00 [0.97, 1,00] 
1.00 [0.98, 1.00] 
0.93 [0.91, 0.95] 
0.96 [0.93, 0.98] 
0,99 [0.99, 1.00] 
1.00 [0.92, 1,00] 
1.00 [0.98, 1.00] 
0,99 [0.97, 1.00] 
1.00 [0.97, 1.00] 
1.00 [0.99, 1,00] 
1.00 [0.92, 1.00] 
1.00 [0.95, 1.00] 
0.99 [0.98, 1,00] 


se . 
. 5 

ee . 
—— — 
a . 

ae = 

— a 

ae . 

= . 

= . 

es . 

—— . 

ae et 

— . 
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—- a 
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SS . 
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1.00 [0.97, 1.00] | ' ——_ _, , 
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Test 46. Antigen test evaluations - Two group design 


Antigen test evaluations - Two group design 


Study TP FP FN TN Sensitivity (95% Cl} Specificity {95% Cl} Sensitivity (95% Cl)Specificity (95% CI} 
Courtellemont 2020 97 20 4 127 0.96 [0.90, 0,99] 0.86 [0.80, 0.91] 4a nal 
Fenollar 2020({b} 10 7 12 130 0.45 [0.24, 0.68] 0.95 [0.90, 0,98] —— al 
Fourati 2020 [A] 103 O 189 337 0.35 [0.30, 0,41] 1,00 [0.99, 1.00] nll Ld 
Fourati 2020 [B] 175 23 116 314 0.60 [0.54, 0,66] 0.93 [0.90, 0.96] all a 
Fourati 2020 [C] 163 O 132 337 0.55 [0.49, 0,61] 1,00 [0,99, 1.00] * Ld 
Fourati 2020 [D] 177) 8 «120 «337 0.60 [0.54, 0,65] 1,00 [0.99, 1.00] all Ld 
Fourati 2020 [E] 182 0 113 337 0.62 [0.56, 0.67] 1,00 [0,99, 1.00] nal Ld 
PHE 2020(a} 95 0 83 940 0,53 [0.46, 0.61] 1,00 [1.00, 1.00] > | 
Porte 2020a 77 60 5S 45 0.94 [0.86, 0,98] 1,00 [0.92, 1.00] + 4 
Porte 2020b [A] 3006C(1 2 -.-31 0,94 [0.79, 0,99] 0,97 [0,84, 1.00] + —- 
Porte 2020b [B] 29 #1 3 631 0,91 [0.75, 0,98] 0,97 [0,84, 1,00] — — 
Schildgen 2020 [A] 14 4 28 27 0.33 [0.20, 0,50] 0.87 [0.70, 0.96] + — 
Schildgen 2020 [B] 21 7 21 24 0,50 [0.34, 0,66] 0,77 [0.59, 0,90] —_ —- 
Schildgen 2020 [C] 37 25 5 6 0.88 [0.74, 0,96] 0.19 [0.07, 0,37] — -— 

Takeda 2020 so 0 12 100 0,81 [0.69, 0,90] 1.00 [0.96, 1.00] + a 
Veyrenche 2020 13° 0 32 20 0,29 [0,16, 0,44] 1,00 [0,83, 1.00] + — 
Weitzel 2020 [A] 49 0 30 30 0.62 [0.50, 0,73] 1,00 [0.88, 1.00] + 4 
Weitzel 2020 [B] Oo ol 9 9 0,00 [0,00, 0,34] 0.90 [0,55, 1.00] #—— — 
Weitzel 2020 [C] 13 0 65 31 0.17 [0,09, 0,27] 1,00 [0.89,1.00]) —#— = 
Weitzel 2020 [D] 68 0 12 31 0.85 [0.75, 0,92] 1,00 [0.89, 1.00] 


t+ fy + + + 4 Ff 
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Test 47. Antigen test evaluations - Unclear design 


Antigen test evaluations - Unclear design 


Study TP FP FN TN Sensitivity (95% Cl} Specificity {95% Cl} Sensitivity (95% Cl)Specificity (95% CI} 
Liotti 2020 49 4 55 251 0.47 (0.37, 0,57] 0,98 [0,96, 1,00] = a 
Nash 2020 80 8 20 82 0.80 [0,71, 0.87] 0,91 [0,83, 0.96) = 


0 


k— tS 
020406081 0020406081 


Test 48. Molecular test evaluations - Single group design 


Molecular test evaluations - Single group design 


Study TP FP FN TN Sensitivity (95% Cl} Specificity (95% CI) Sensitivity (95% Cl)Specificity (95% Cl} 
Assennato 2020 87 3 1 81 0,99 [0,94, 1.00] 0.96 [0,90, 0.99] a + 
Collier 2020 29 3 44113 0,88 [0.72, 0.97] 0,97 [0,93, 0,99] — a 
Cradic 2020{a} 30 Oo 3 151 0,91 [0.76, 0,98] 1,00 [0,98, 1.00] — a 
Cradic 2020{b) 12 0 1 169 0,92 [0.64, 1.00] 1,00 [0.98, 1,00] ——- a 
Ghofrani 2020 16 1 1 =9$5 0,94 [0,71, 1.00] 0,99 [0,94, 1,00] —_— a 
Gibani 2020 67 Oo 4 315 0,94 [0,86, 0,98] 1,00 [0,99, 1,00] + a 
Harrington 2020 139 2 47 336 0.75 [0.68, 0.81] 0,99 [0.98, 1.00] all a 
Hogan 2020 34 O 16 50 0.68 [0.53, 0.80] 1,00 [0.93, 1.00] —- +1 
Hou 2020 i476 63. 66 12? 0,96 [0.92, 0.99] 0,96 [0.91, 0,99] = a 
Jin 2020 4 0 2 46 0,67 [0.22, 0.96] 1,00 [0,92, 1.00] ss 4 
Jokela 2020 60 Oo OO 30 1,00 [0.94, 1.00] 1,00 [0.88, 1.00] 4 — 
Lephart 2020 [A] lL Oo S&.. -59 0,69 [0.41, 0.89] 1,00 [0.94, 1,00] —— 4 
Lephart 2020 [B] 16 2 0 56 1,00 [0.79, 1.00] 0,97 [0.88, 1.00] —1 4 
Lieberman 2020 13 0 GO 13 1,00 [0.75, 1.00] 1,00 [0.75, 1,00] —1 —1 
Mitchell 2020 33: 0 13 15 0,72 [0.57, 0.84] 1,00 [0.78, 1.00] —- —1 
Moran 2020 42 1 o 660 1,00 [0.92, 1.00] 0.98 [0.91, 1.00] = 41 
Thwe 2020 8 O 6 147 0,57 [0.29, 0.82] 1,00 [0,98, 1.00] —_—i Lt 
Wong 2020 118 oO 1 43 0,99 [0,95, 1.00] 1,00 [0,92, 1,00] 
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Test 49. Molecular test evaluations - Two group design 


Molecular test evaluations - Two group design 





Study TP FP FN TN Sensitivity (95% Cl} Specificity (95% Cl} Sensitivity (95% ClSpecificity (95% Cl} 
Dust 2020 20 0 OO 18 1,00 [0,83, 1.00] 1,00 [0,81, 1.00] —1 —1 
Goldenberger 2020 10 =O 0 ie] 1.00 [0.69, 1.00] 1,00 [0.66, 1.00] ——4 ——4 
Loeffelholz 2020 219 11 #1 250 1.00 [0,97, 1.00] 0.96 [0,93, 0.98] LI = 
Moore 2020 $4 0 25 79 0.79 [0.71, 0.86] 1.00 [0.95, 1.00] + a 
Smithgall 2020 [A] 65 0 23 25 0.74 [0,63, 0.83] 1,00 [0.86, 1.00] +a — 
Smithgall 2020 [B] 87 2 1 23 0,99 [0,94, 1.00] 0,92 [0,74, 0,99] a — 
Wolters 2020 58 0 OQ 30 1.00 [0,94, 1.00] 1,00 [0.88, 1.00] 41 —- 
Zhen 2020 [A] 5o0.0—CliO0 7 50 0,88 [0.76, 0.95] 1,00 [0,93, 1,00] + 41 
Zhen 2020 [B] 57 0 1 50 0,98 [0,91, 1,00] 1,00 [0,93, 1,00] 

bozcacsoar bozozleceT 


Test 50. Molecular test evaluations - Unclear design 


Molecular test evaluations - Unclear design 


Study TP FP FN TN Sensitivity (95% CI} Specificity (95% CI} Sensitivity (95% Cl)Specificity (95% Cl} 
SoRelle 2020 32 0 7 44 0,82 [0,66, 0,92] 1.00 [0.92, 1.00] a 4 
Stevens 2020 53 0 1 50 0.98 [0.90, 1.00] 


1,00 [0,93, 1.00] ' = 


0020406081 002040608 1 


ADDITIONAL TABLES 


Table 1. Description of studies 


No. of studies (%) 


Participants 


Number of studies 


Antigen tests 


48 


Rapid molecular 


29 





Sample size (by test Median (IQR) 291.5 (155 to 502.5) 104 (75 to 172) 
type) 
Range 56 to 1676 19 to 524 
Number of COV- Median (IQR) 99.5 (45.5 to 128.5) 50 (20 to 88) 
ID-19 cases (by test 
type) 
Range 0,951 6, 220 
Setting COVID-19 test centre 22 (46) 0 (0) 
Contacts 4 (8) 0 (0) 
Hospital A&E 3 (6) 3 (10) 
Hospital inpatient 2 (4) 2 (7) 
Laboratory-based 11 (23) 20 (69) 
Mixed 4 (8) 4 (14) 
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Table 1. Description of studies (continued) 


Symptom status 


Study design 


Recruitment struc- 
ture 


Reference standard 
for COVID-19 cases 


Reference standard 
for non-COVID-19 


Tests 


Total number of 
test evaluations 


Number of tests per 
study 


Unclear 
Asymptomatic 
Symptomatic 

Mainly symptomatic? 
Mixed 


Not reported 


Single group - sensitivity and specificity 


Two or more groups - sensitivity and specificity 
Unclear 

Single group - sensitivity only 

Single group - specificity only 


All RT-PCR-positive 


COVID suspects (single RT-PCR-negative) 


COVID suspects (double+ RT-PCR-negative) 
Current other disease (RT-PCR-negative) 
Pre-pandemic (not described) 


Pre-pandemic other disease 


No. of studies = 42 


39 (93) 


No. of evaluations (%) 


58 


14 (48) 


17 (59) 


No. of studies = 26 


24 (92) 


32 


26 (90) 
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Table 1. Description of studies (continued) 


Test method 


Sample type 


Sample storage 


Sample collection 


CGIA 

FIA 

LFA (alkaline phosphatase labelled) 
LFA (not otherwise specified) 
Automated RT-PCR 

Isothermal PCR 

Other molecular (PCR + LFA) 

NP alone 

NP + OP combined 

Nasal alone 

OP alone 

Two or more of NP, or nasal or OP 
Saliva 

Other 

Mixed (including lower respiratory) 
Not specified 

Direct 

VTM 

Saline 

Direct or VTM 

VTM or PBS 

VTM or other 

Not specified 

HCW 

Trained non-HCW 

Self-collected 

HCW or self-collection 


Not specified 


41 (71) 


34 (59) 
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Table 1. Description of studies (continued) 
Sample testing HCW (on-site) 

Trained non-HCW (on-site) 

HCW or on-site laboratory personnel 

Not specified (on-site testing) 

Laboratory staff 

Not stated (laboratory setting) 

IFU compliance No 


Yes 


Unclear 


12 (21) 
15 (26) 
16 (28) 
29 (50) 


13 (22) 


16 (50) 
16 (50) 
9 (28) 


7 (22) 


A&E: accident and emergency department; CGIA: colloidal gold immunoassay; Cl: confidence intervals; DRW: Diagnostics for the Re- 
al World; FIA: fluorescent immunoassay; HCW: healthcare worker; IFU: instructions for use; IQR: inter-quartile range; LFA: lateral 
flow assay; NP: nasopharyngeal; OP: oropharyngeal; PBS: phosphatase-buffered saline; RT-PCR: reverse transcription polymerase 


chain reaction; VTM: viral transport medium 


a‘mainly’ symptomatic indicates = 75% of included participants reported as symptomatic. 


Table 2. Antigen tests: summary of sensitivity and specificity analyses 


Subgroup Test Evalua- Samples Cases 
tions 

Overall analysis 

Evaluations reporting both sensitivity 51 21,614 6136 

and specificity 

Evaluations reporting sensitivity 57 22,605 7127 

data 

Evaluations reporting specificity 52 22,152 6136 

data 


Subgroup analyses (with sensitivity analyses restricting to direct comparisons) 


Symptom Symptomatic 37 15,530 4410 
status (all) 
Asymptomatic 12 1581 295 
Difference 


Average sensitivity, % 


(95% Cl) 


68.9 (61.8 to 75.1) 


67.7 (60.8 to 74.0) 


N/A 


72.0 (63.7 to 79.0) 


58.1 (40.2 to 74.1) 


-13.8 (-33.1 to 5.4) 


P=0.159 


Average speci- 
ficity, % (95% 
Cl) 


99.6 (99.0 to 
99.8) 


N/A 


99.5 (99.0 to 
99.8) 


99.5 (98.5 to 
99.8) 


98.9 (93.6 to 
99.8) 


-0.6 (-2.6 to 1.4) 


P=0.551 
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Table 2. Antigen tests: summary of sensitivity and specificity analyses (continued) 


Time post- 
symptom 
onset 


(sensitivity 
only) 


Ct value 


(sensitivity 
only) 


Study de- 
sign 


Symptomatic: direct 
comparison 


Asymptomatic: direct 
comparison 


Difference 


Mixed symptoms or 
not reported 


Week 1 
Week 2 


Difference 


Week 1: direct com- 
parison 


Week 2: direct com- 
parison 


Difference 


Higher viral load (< or 
< 25 Ct threshold)? 


Lower viral load (> or 
>= 25 Ct threshold) 


Difference 


Higher viral load (s 32 
or33 Ct threshold) 


Lower viral load (> 32 
or 33 Ct threshold) 


Difference 


Single group: sensitivi- 
ty and specificity 


Two or more groups: 
sensitivity and speci- 
ficity 


9 


19 


26 


22 


22 


22 


36 


36 


15 


15 


29 


20 


2437 


1182 


6220 


5769 


935 


4978 


935 


2613 


2632 


2127 


346 


15,336 


5729 


890 


213 


2392 


2320 


692 


2164 


692 


2613 


2632 


2127 


346 


3536 


2396 


68.0 (51.4 to 81.1) 


53.6 (35.0 to 71.3) 


-14.4 (-38.8 to 10.0) 


P=0.246 


63.0 (52.2 to 72.6) 


78.3 (71.1 to 84.1)4 
51.0 (40.8 to 61.0)¢ 


-27.3 (-32.8 to -21.9) 


P<0.0001 


76.6 (68.2 to 83.4)4 


48.8 (37.9 to 59.8)4 


-27.9 (-33.3 to -22.5) 


P<0.0001 


94.5 (91.0 to 96.7)¢ 


40.7 (31.8 to 50.3)¢ 


-53.8 (-63.6 to -44.1) 


P<0.0001 


82.5 (74.0 to 88.6)4 


8.9 (3.3 to 21.7)¢ 


-73.5 (-84.7 to -62.4) 


P<0.0001 


72.1 (64.8 to 78.3) 


64.1 (48.5 to 77.2) 


99.2 (83.9 to 100) 


99.2 (85.5 to 100) 


-0.01 (-3.2 to 
3.2), 


P=0.995 


98.4 (98.0 to 
98.8) 


N/A 


N/A 


N/A 


N/A 


N/A 


N/A 


N/A 


N/A 


99.6 (99.1 to 
99.8) 


97.3 (96.7 to 
97.8) 
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Table 2. Antigen tests: summary of sensitivity and specificity analyses (continued) 





-8.0 (-24.2 to 8.2) -2.3 (-2.9 to -1.6) 
P=0.334 P<0.0001 
Unclear 2 549 204 65.2 (39.6 to 84.3) 96.3 (88.0 to 
98.9) 
Test CGIA 36 17,448 5085 64.0 (55.7 to 71.6) 99.0 (98.8 to 
method 99.2) 
FIA 9 2820 712 79.6 (67.5 to 88.0) 97.7 (95.3 to 
98.8) 
Difference 15.6 (2.6 to 28.5) -1.3 (-3.0 to 0.3) 
P=0.019 P=0.113 
LFA (not otherwise 5 1184 277 78.0 (46.0 to 93.7) 96.0 (94.5 to 
specified) 97.1) 
LFA (ALP) 1 162 62 80.6 (68.6 to 89.6) 100 (96.4 to 100) 


ALP: alkaline phosphatase labelled; CGIA: colloidal gold immunoassay; Cl: confidence intervals; Ct: cycle threshold; FIA: fluorescent 
immunoassay; LFA: lateral flow assay; N/A: not applicable 


“Separate pooling of sensitivity or specificity, or both. 
5 threshold for 'higher' viral load was < 25 Ct in 18 evaluations and < 25 Ct in 18 evaluations 
€ threshold for 'higher' viral load < 33 Ct in 13 evaluations and < 32 in 2 evaluations 


Table 3. Antigen tests: summary data by test brand and compliance with manufacturers' instructions for use 


Test All IFU-compliant 
Number Average sensitiv- Average Number Average Average 
of evalua- ity, % (95% Cl) specificity,% of evalua- sensitivity, specificity, 
tions; sam- (95% Cl) tions;sam- %(95%ClI) %(95%Cl) 
ples (cas- ples (cas- 
es) es) 
AAZ - COVID-VIRO 1;632 (295) 61.7 (55.9to67.3) 100(98.9to 
100) 


(2 studies not pooled) 
1;248(101)  96.0(90.2t098.9)  86.4(79.8to 1;248(101) 96.0 (90.2 86.4 (79.8 


91.5) to 98.9) to 91.5) 
Abbott - Panbio Covid-19 Ag 10; 5509 72.0 (60.6 to 81.1) 99.3 (99.0 to 5;1776 72.0 (56.5 99.2 (98.5 
(1849) 99.6) (362) to 83.5) to 99.5) 
including sensitivity-only cohort 11; 2031 72.8 (62.6 to 81.0)4 6; 544 (544) 73.5 (61.1 to 
(2031) 83.0)a 


Becton Dickinson - BD Veritor 2; 602 (55) 82.3 (62.1 to 93.0) 99.5 (98.3 to 
99.8) 


including sensitivity-only cohort 3; 180 (180) 79.4 (72.9 to 84.7)4 
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Table 3. Antigen tests: summary data by test brand and compliance with manufacturers' instructions for 





UBTONOTE’NowCheck COVID-19 1; 400(102) 89.2(81.5t0 94.5) 97.3(94.8to —-1;400(102) 89.2(81.5 97.3 (94.8 
Ag 98.8) to 94.5) to 98.8) 
Biosynex - Biosynex COVID-19 1;634 (297) 59.6 (53.8 to 65.2) 100 (98.9 to 
Ag BSS 100) 

Coris Bioconcept- COVID-19Ag 7;1781 39.7 (31.3 to 48.7) 98.3 (97.4 to 7; 1781 39.7 (31.3 98.3 (97.4 
Respi-Strip (707) 98.9) (707) to 48.7) to 98.9) 
E25Bio - DART (N-based) 1;190(100)  80.0(70.8 to 87.3) 91.1 (83.2 to 

96.1) 
Fujirebio -ESPLINESARS-CoV-2.  1;162(62) 80.6 (68.6 to 89.6) 100(96.4to 

100) 
(2 studies not pooled) 

1;103(103) 11.6 (6.2 to 19.5) 
Innova Medical Group - Innova 3; 2945 47.9 (34.3 to 61.8) 99.8 (99.5 to 1; 1676 57.5 (52.3 99.6 (99.1 
SARS-CoV-2 Ag (596) 99.9) (372) to 62.6) to 99.9) 
including sensitivity-only cohorts 5; 1017 59.0 (43.4 to 73.0)a 3; 793 69.1 (58.3 to 
78.2)a 

including specificity-only cohort 4; 2887 99.8 (99.5 to 2; 1842 99.7 (99.3 to 

99.9)a 99.9)a 
Liming Bio-Products - 1; 19 (9) 0 (0 to 33.6) 90.0 (55.5 to 
StrongStep® COVID-19 Ag 99.7) 
Quidel Corporation - SOFIA 1; 64 (32) 93.8 (79.2 to 99.2) 96.9 (83.8 to 
SARS Ag 99.9) 
RapiGEN - BIOCREDIT COVID-19 5; 2010 63.3 (45.7 to 78.0) 99.5 (99.1 to 3; 1828 73.0 (57.4 99.8 (99.4 
Ag (310) 99.8) (189) to 84.4) to 99.9) 
including sensitivity-only cohort 6;470(470) 57.7 (39.8 to 73.8) 9 
Roche - SARS-CoV-2 1; 73 (42) 88.1(74.4to 96.0)  19.4(7.5to 

37.5) 
Savant Biotech - Huaketai 1; 109 (78) 16.7 (9.2 to 26.8) 100 (88.8 to 
SARS-CoV-2 N Protein 100) 
SD Biosensor - STANDARD F 4; 1552 72.6 (54.0 to 85.7) 97.5 (96.4 to 2; 1129 75.5 (68.2 97.2 (96.0 
COVID-19 Ag (295) 98.2) (159) to 81.5) to 98.1) 
SD Biosensor - STANDARD Q 6; 3480 79.3 (69.6 to 86.6) 98.5 (97.9 to 4; 2522 85.8 (80.5 99.2 (98.2 
COVID-19 Ag (821) 98.9) (421) to 89.8) to 99.6) 
Shenzhen Bioeasy Biotech - 3;965(177) 86.2 (72.4to 93.7) 93.8 (91.9to 1;727(15) 66.7 (38.4 93.1 (91.0 
2019-nCoV Ag 95.3) to 88.2) to 94.9) 
development-phase publication —_}.939 (208) ~—«67.8(61.0to 74.1) 100(88.8 to 

100) 
Ag: antigen; Cl: confidence interval; IFU: [manufacturers'] instructions for use; N: nucleoprotein 
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@Separate pooling of sensitivity or specificity. 


b2x2 tables combined prior to calculating estimates. 


Table 4. Antigen tests: summary data by symptom status, test brand and compliance with manufacturers' 


instructions for use 





All IFU-compliant 
Number Average sensitiv- Average Number Average Average 
of evalua- ity, % (95% Cl) specificity,% of evalua- sensitivity, specificity, 
tions; sam- (95% Cl) tions;sam- %(95%ClI) %(95%Cl) 
ples (cas- ples (cas- 
es) es) 
SYMPTOMATIC participants by test 
AAZ - COVID-VIRO 1;632(295) 61.7 (55.9 to 67.3) 100 (98.9 to 
100) 
(2 studies not pooled) 
1;248(101)  96.0(90.2to 98.9)  86.4(79.8to 1;248(101) 96.0 (90.2 86.4 (79.8 
91.5) to 98.9) to 91.5) 
Abbott - Panbio Covid-19 Ag 8; 3699 74.1 (60.8 to 84.0) 99.8 (99.5 to 3; 1094 75.1 (57.3 99.5 (98.7 
(1162) 99.9) (252) to 87.1) to 99.8) 
including sensitivity-only cohort 9; 1344 74.8 (63.4 to 83.6)4 4; 434 (434) 76.2 (63.6 to 
(1344) 85.4)a 
Becton Dickinson - BD Veritor 2; 602 (55) 82.3 (62.1 to 93.0) 99.5 (98.3 to 
99.8) 
including sensitivity-only cohort 3; 180 (180) 79.4 (72.9 to 84.7)@ 
BIONOTE - NowCheck COVID-19 1;400(102)  89.2(81.5to 94.5) 97.3 (94.8 to 1;400 (102) 89.2 (81.5 97.3 (94.8 
Ag 98.8) to 94.5) to 98.8) 
Biosynex - Biosynex COVID-19 1;634 (297) 59.6 (53.8 to 65.2) 100 (98.9 to 
Ag BSS 100) 
Coris Bioconcept-COVID-19Ag  3;780(414) 34.1 (29.7 to 38.8)¢ 100 (99.0 to 3;780 (414) 34.1 (29.7 100 (99.0 to 
Respi-Strip 100)a,b to 38.8)¢ 100)a,b 
Fujirebio -ESPLINE SARS-CoV-2 _1; 88 (88) 11.4 (5.6 to 19.9) 
Innova Medical Group - Innova 2; 2794 56.2 (52.0 to 60.3) 99.8 (99.5 to 1; 1676 57.5 (52.3 99.6 (99.1 
SARS-CoV-2 Ag (550) 99.9) (372) to 62.6) to 99.9) 
including sensitivity-only cohorts 4;971(971) 65.5 (54.8 to 74.9)f 3; 793 (793) 69.1 (58.3 to 
78.2)t 
Liming Bio-Products - 1; 19 (9) 0 (0 to 33.6) 90.0 (55.5 to 
StrongStep® COVID-19 Ag 99.7) 
Quidel Corporation - SOFIA 1; 64 (32) 93.8 (79.2 to 99.2) 96.9 (83.8 to 
SARS Ag 99.9) 
RapiGEN - BIOCREDIT COVID-19 3;608(206) 58.4(36.3to77.5)  96.4(82.8to 1;476 (117) 74.4(65.5 98.9 (97.2 
Ag 99.3) to 82.0) to 99.7) 
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Table 4. Antigen tests: summary data by symptom status, test brand and compliance with manufacturers' 


instructions for use (continued) 


Roche - SARS-CoV-2 


Savant Biotech - Huaketai 
SARS-CoV-2 N Protein 


SD Biosensor - STANDARD F 
COVID-19 Ag 


SD Biosensor - STANDARD Q 
COVID-19 Ag 


Shenzhen Bioeasy Biotech - 
2019-nCoV Ag 


1; 23 (10) 


1; 109 (78) 


3; 1193 


(191) 


5; 2760 
(731) 


3; 965 (177) 


ASYMPTOMATIC participants by test 


Abbott - Panbio Covid-19 Ag 


Coris Bioconcept - COVID-19 Ag 
Respi-Strip 


Fujirebio - ESPLINE SARS-CoV-2 


RapiGEN - BIOCREDIT COVID-19 
Ag 


Roche - SARS-CoV-2 


SD Biosensor - STANDARD Q 
COVID-19 Ag 


6; 1097 
(190) 
1; 45 (14) 


1; 15 (15) 


2; 140 (60) 


1; 27 (13) 


2; 272 (18) 


100 (69.2 to 100) 


16.7 (9.2 to 26.8) 


78.0 (71.6 to 83.3) 


80.1 (68.5 to 88.1) 


86.2 (72.5 to 93.7) 


58.1 (41.7 to 72.9) 


28.6 (8.4 to 58.1) 


13.3 (1.7 to 40.5) 


63.2 (21.7 to 91.4) 


84.6 (54.6 to 98.1) 


61.1 (37.9 to 80.2) 


7.7 (0.2 to 
36.0) 


100 (88.8 to 
100) 


97.2 (96.0 to 
98.1) 


98.1 (97.4 to 
98.6) 


93.8 (91.9 to 
95.3) 


98.4 (92.2 to 
99.7) 


100 (88.8 to 
100) 


N/A 


98.9 (82.9 to 
99.9) 


14.3 (1.8 to 
42.8) 


99.6 (97.3 to 
99.9) 


Ag: antigen; Cl: confidence interval; N: nucleoprotein; N/A: not applicable 


Aseparate pooling of sensitivity or specificity. 
b2x2 tables combined prior to calculating estimates. 


Table 5. Molecular tests: summary of sensitivity and specificity analyses 


Test or subgroup Evalua- 
tions 
Overall analysis 
Evaluations reporting both sensitivity 29 
and specificity 
Evaluations reporting sensitivity data@ 32 


Samples 


4351 


4537 


Cases 


1787 


1973 


Subgroup analyses (with sensitivity analyses restricting to direct comparisons) 


Viral load High viral load (< 30 Ct) 6 


204 


204 


2;1129 
(159) 


3; 1947 
(336) 


1; 727 (15) 


2; 474 (47) 


1; 45 (14) 


1; 113 (47) 


1; 127 (13) 


75.5 (68.2 97.2 (96.0 
to 81.5) to 98.1) 


88.1 (84.2 99.1 (97.8 
to 91.1) to 99.6) 


66.7 (38.4 93.1 (91.0 
to 88.2) to 94.9) 


48.9 (35.1 98.1 (96.3 
to 62.9) to 99.1) 


28.6(8.4to  100(88.8to 
58.1) 100) 


85.1 (71.7 100 (94.6 to 
to 93.8) 100) 


69.2 (38.6 99.1 (95.2 
to 90.9) to 100) 


Average sensitivity, Average specifici- 


% (95% Cl) 


95.1 (90.5 to 97.6) 


95.5 (91.5 to 97.7) 


100 (98.2 to 100); 


ty, % (95% Cl) 


98.8 (98.3 to 99.2) 


N/A 


b N/A 
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Table 5. Molecular tests: summary of sensitivity and specificity analyses (continued) 


(sensitivity 
only) 


By study 
design 


Test brand 


Test brand 


(restrict- 
ed to IFU- 
compliant) 


Discrepant 
analysis 


Low viral load (> 30 Ct) 
Single group - sensitivity 
and specificity 


Two or more groups - 
sensitivity and specificity 


Difference 


Unclear designs 


Abbott - ID NOW 
Cepheid - Xpert Xpress 


Difference 


Abbott - ID NOW (includ- 
ing sensitivity only co- 
hort) 

Cepheid - Xpert Xpress 
(including sensitivity only 
cohorts) 


DNANudge - COVID 
Nudge 


Diagnostics for the Real 
World - SAMBA II 


Mesa Biotech - Accula 
Abbott - ID NOW 
Cepheid - Xpert Xpress 
DRW - SAMBA II 


DNANudge - COVID 
Nudge 


Before discrepant analy- 
sis 


After discrepant analysis 


Difference 


6 


18 


13 


15 


149 


2899 


1265 


187 


1853 


1691 


1949 


1781 


386 


321 


100 


812 


100 


149 


386 


1533 


1533 


149 


976 


718 


93 


634 


911 


730 


1001 


71 


121 


50 


222 


29 


33 


71 


623 


632 


95.6 (55.7 to 99.7) 


93.2 (85.5 to 97.0) 


97.2 (90.7 to 99.2) 


4.0 (-2.2 to 10.1) 


P=0.211 


93.2 (71.0 to 98.7)9 


78.6 (73.7 to 82.8) 
99.1 (97.7 to 99.7) 


19.8 (14.9 to 24.7) 


P<0.0001 


81.5 (75.2 to 86.5)¢ 


99.1 (97.8 to 99.6)2 


94.4 (86.2 to 98.4) 


96.0 (81.1 to 99.3) 


68.0 (53.3 to 80.5) 
73.0 (66.8 to 78.4) 
100 (88.1 to 100)2 
87.9 (71.8 to 96.6) 


94.4 (86.2 to 98.4) 


97.9 (88.1 to 99.7) 


99.2 (93.6 to 99.9) 


1.3 (-2.8 to 5.4) 


P=0.528 


N/A 


99.4 (98.4 to 99.8) 


99.3 (96.5 to 99.8) 


-0.2 (-1.3 to 1.0) 


P=0.771 


100 (96.2 to 
100)a,b 


99.8 (99.2 to 99.9) 
97.9 (94.6 to 99.2) 


-1.9 (-3.8 to -0.1) 


P=0.036 


N/A 


N/A 


100 (98.8 to 100) 


97.0 (93.5 to 98.6) 


100 (92.9 to 100) 
99.7 (98.7 to 99.9) 
97.2 (89.4 to 99.3)4 
97.4 (92.6 to 99.5) 


100 (98.8 to 100) 


97.8 (96.6 to 98.6) 


99.6 (98.8 to 99.8) 


1.8 (0.7 to 2.8) 


P=0.001 
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Table 5. Molecular tests: summary of sensitivity and specificity analyses (continued) 


Cl: confidence interval; Ct: cycle threshold; IFU: [manufacturers'] instructions for use; N/A: not applicable 


@Separate pooling of sensitivity or specificity. 
b2x2 tables combined prior to calculating estimates. 


APPENDICES 


Appendix 1. Summary of World Health Organization and Chinese National Health Commission Guidelines for the 


diagnosis of SARS-CoV-2 
Table A: World Health Organization guidelines for the diagnosis of SARS-CoV-24 


Includes laboratory testing guidelines and global surveillance guidelines 


Date range Definition of confirmed case Definition of Definition of 
(2020) confirmed suspect case 
non-case 
10-30 January 10-30 January: no documentation to de- None stated No definition 
2020 fine at this time (before first date of glob- of 'suspect 
al guidelines) case’ at this 


31 January onwards: a confirmed case is 
a person with laboratory confirmation of 


time, but case 
definitions for 


COVID-19 infection, irrespective of clinical surveillance 
signs and symptoms. are defined 
as a combina- 
No prescribed test in laboratory guide- tion of symp- 
lines, suggested tests from 10 January toms and ex- 
include broad coronavirus RT-PCR (with posure, with 


sequencing of precise virus in test posi- 
tives), whole genome sequencing, broad 
coronavirus serology on paired samples, 


more severe 
symptoms re- 


quiring less 
microscopy, culture evidence for 
(Lab 10 January). Four suggested tests exposure 
from 17 January: broad coronavirus RT- 
31 January-26 PCR (with sequencing of precise virus in None stated Suspect case 
February 2020 test positives), NAAT for SARS-CoV-2 when defined as 
it becomes available, whole genome se- combination 
quencing, and broad coronavirus serolo- of symptoms 


gy on paired samples. 
States that once specific NAAT assays 
are developed and validated, confirma- 


and exposure, 
with more se- 


Definition 
of probable 
case 


No definition 
at this time 


A suspect case 
with inconclu- 
sive laborato- 
ry results or is 
test-positive 
using a pan- 


Role of serology 
in testing 


Serological test- 
ing may be use- 
ful to confirm 
immunologic 
response toa 
pathogen from 
a specific viral 
group, e.g. coro- 
navirus. Best re- 
sults from sero- 
logic testing re- 
quires the col- 
lection of paired 
serum samples 
(in the acute and 
convalescent 
phase) from cas- 
es under investi- 
gation. 





. : : vere symp- coronavirus 
tion will be based on specific detection of toms requir- assay without 
unique sequences of viral nucleic acid by ing less evi- laboratory ev- 
RT-PCR. dence for ex- idence of oth- 
posure er respirato- 
ry pathogens 
(global 31 
January) 
27 February-1 None stated Suspect case Asuspected 
March 2020 defined as case with in- 
combination conclusive 
2 March-19 A person with laboratory confirmation of One or more of symptoms laboratory re- —_ |n cases where 
March 2020 COVID-19 infection, irrespective of clinical negative re- and exposure, — sults NAAT assays are 
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19 March 
2020-current 
(12-03-21) 


NAAT: nucleic acids amplification test; RT-PCR: reverse transcription polymerase chain reaction 


signs and symptoms (global 31 January, 


27 February, 20 March) 


Laboratory confirmation of cases by NAAT 
specific to SARS-CoV-2 such as real-time 
RT-PCR with confirmation by nucleic acid 


sequencing when necessary. The viral 
genes targeted so far include the N, E, 
and RdRP genes. 


rule out the 
possibility 
of COVID-19 


Ss 


In areas with no known COVID-19 virus 


circulation confirmation requires: 


e NAAT-positive for at least two different 
targets on the COVID-19 virus genome, 
of which at least one target is preferably 
specific for COVID-19 virus (or SARS-like 
coronavirus) using a validated assay; 


OR 


« NAAT-positive result for betacoron- 
avirus, and COVID-19 virus identified 
by sequencing partial/whole genome 
of virus (sequence target larger or dif- 
ferent from the amplicon probed in the 


NAAT assay). 


Discordant results should be resampled. 


In areas where COVID-19 virus is wide- 


ly spread a simpler algorithm might be 
adopted (e.g. RT-PCR of a single discrimi- 


natory target) 


sult does not 


virus infection 


with more se- 
vere symp- 
toms requir- 
ing less evi- 
dence for ex- 
posure, OR 
defined by 
symptoms re- 
quiring hospi- 
talisation and 
an absence of 
alternative ex- 
planation 


(global 27 
February) 


Probable case 
A suspect case 
for whom 
testing for 

the COVID-19 
virus is incon- 
clusive 

OR 

A suspect case 
for whom test- 
ing could not 
be performed 
for any rea- 
son. 


negative and 
there is a strong 
epidemiologi- 
cal link to COV- 
ID-19 infection, 
paired serum 
samples (in the 
acute and con- 
valescent phase) 
could support di- 
agnosis once val- 
idated serology 
tests are avail- 
able. 


Serological as- 
says will play an 
important role in 
research and sur- 
veillance but are 
not currently rec- 
ommended for 
case detection. 


aSource data from Laboratory testing of 2019 novel coronavirus (2019-nCoV) in suspected human cases: interim guidance, World Health 
Organization. 10 January, 17 January, 2 March, 19 March, 21 March 2020 (WHO 2020d), and Global surveillance for COVID-19 caused by 
human infection with COVID-19 virus, interim guidance, 31 January, 27 February, and 20 March 2020 (WHO 2020e). 


Table B: Summary of Chinese National Health Commission guidelines for diagnosis and treatment for novel coronavirus 
pneumonia (trial versions 1-7) 





Dates in effect Definition of confirmed case Definition of con- _ Definition of suspect case Role of serology 
firmed non-case in testing 
16-17 January Cases (not confirmed cases) de- Not defined Observation cases: defined as No role 
2020 (version 1) fined as virus genome highly ho- combination of exposure in Wuhan 
mologous to coronaviruses and symptoms focused on pneu- 
monia, leukopenia and lack of im- 
provement. 
18 January-2 Suspect cases with either Suspect casescan Suspect cases: combination of ex- = No role 
March 2020 (ver- be ruled out after posure (such as residence in/trav- 
sions 2, 3, 4,5,5 + real-time fluorescent RT-PCR 2 consecutive neg- el to Wuhan or exposure to a con- 
revised, and 6) indicates positive for new ative respiratory firmed case within 14 days of on- 
coronavirus nucleic acid;OR _ tract nucleic acid set) AND clinical features (such 
« viral gene sequence is high-  teststaken atleast as symptoms: fever, respiratory 
ly homologous to known new = 24 hours apart. symptoms, and tests: chest imag- 
coronaviruses ing, white blood cell and lympho- 
Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 342 


Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 


Collaboration. 


Trusted evidence. 
Informed decisions. 
Better health. 


+4 Cochrane 
tw Library 


(Continued) 


Cochrane Database of Systematic Reviews 





cyte count). Exact definition varies 
slightly with version 


Part of definition 
of cases and con- 
firmed non-cases 


3 March 2020- 
current (12-03-21 
(version 7) : 


Suspect cases with either Suspect cases can 
be ruled out after 
2 negative NAATs, 
taken at least 24 
hours apart, and 
the NCP virus-spe- 
cific IgM and IgG 
are negative after 
7 days from onset. 


Suspect cases: combination of ex- 
posure (such as residence in/trav- 
el to Wuhan or exposure to a con- 
firmed case within 14 days of on- 
set) AND clinical features (such 

as symptoms: fever, respiratory 
symptoms, and tests: chest imag- 
ing, white blood cell and lympho- 
cyte count). 


real-time fluorescent RT-PCR 
indicates positive for new 
coronavirus nucleic acid; OR 
¢ viral gene sequence is high- 
ly homologous to known new 
coronaviruses OR 
* NCP virus-specific IgM and 
IgG are detectable in serum; 
NCP virus-specific IgG is de- 
tectable or reaches a titration 
of at least 4-fold increase dur- 
ing convalescence compared 
with the acute phase. 


NAAT: nucleic acids amplification test; NCP: novel coronavirus pneumonia; RT-PCR: reverse transcription polymerase chain reaction; 
Source: Table from Cheng 2020 


Appendix 2. Cochrane COVID-19 Study Register searches 


Source 


Clinical Trials.gov 


WHO International Clinical Tri- 
als Registry Platform 


PubMed 


Strategy 


COVID-19 OR 2019-nCoV OR SARS-CoV-2 OR 2019 novel coronavirus OR severe acute respiratory 
syndrome coronavirus 2 OR Wuhan coronavirus OR coronavirus 


Screen the entire COVID-19.csv file available from who.int/emergencies/diseases/novel-coron- 
avirus-2019 


(2019 nCoV[tiab] OR 2019nCoV[tiab] OR corona virus[tiab] OR corona viruses[tiab] OR coro- 


navirus[tiab] OR coronaviruses[tiab] OR COVID[tiab] OR COVID19[tiab] OR nCov 2019[tiab] 

OR SARS-CoV2[tiab] OR SARS CoV-2[tiab] OR SARSCoV2[tiab] OR SARSCoV-2[tiab] OR "Coron- 
avirus"[Mesh:NoExp] OR "COVID-19"[nm] OR "COVID-19 drug treatment" [nm] OR "COVID-19 di- 
agnostic testing"[nm] OR "COVID-19 serotherapy"[nm] OR "COVID-19 vaccine"[nm] OR "LAMP as- 
say"[nm] OR "severe acute respiratory syndrome coronavirus 2"[nm] OR "spike protein, SARS- 
CoV-2"[nm]) NOT ("animals"[mh] NOT "humans"[mh]) NOT (editorial[pt] OR newspaper article[pt]) 


Appendix 3. Living search from the University of Bern 


The following information ispmbern.github.io/covid-19/living-review/ 


collectingdata.html). 


is taken from the university of Bern website (see: 


The register is updated daily and CSV file downloads are made available. 


1 April 2020 


From 1 April 2020, we will retrieve the curated BioRxiv/MedRxiv dataset (connect.medrxiv.org/relate/content/181). 


26 to 31 March 2020 


MEDLINE: (\"Wuhan coronavirus\" [Supplementary Concept] OR \"COVID-19\" OR \"2019 ncov\"[tiab] OR ((\"novel coronavirus\"[tiab] OR 
\"new coronavirus\"[tiab]) AND (wuhan|[tiab] OR 2019[tiab])) OR 2019-nCoV[AIl Fields] OR (wuhan[tiab] AND coronavirus[tiab]))))) 
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Embase: (nCoV or 2019-nCoV or ((new or novel or wuhan) adj3 coronavirus) or covid19 or covid-19 or SARS-CoV-2).mp. 





BioRxiv/MedRxiv: ncov or corona or wuhan or COVID or SARS-CoV-2 


With the kind support of the Public Health & Primary Care Library PHC (www.unibe.ch/university/services/university_library/ 
faculty_libraries/medicine/public_health_amp_primary_care_library_phc/index_eng.html), and following guidance of the Medical 
Library Association (www.mlanet.org/p/cm/ld/fid=1713). 





1 January 2020 to 25 March 2020 


MEDLINE: ("Wuhan coronavirus" [Supplementary Concept] OR "COVID-19" OR "2019 ncov"[tiab] OR (("novel coronavirus"[tiab] OR "new 
coronavirus" [tiab]) AND (wuhan[tiab] OR 2019[tiab])) OR 2019-nCoV[AIl Fields] OR (wuhan|[tiab] AND coronavirus[tiab]))))) 


Embase: ncov OR (wuhan AND corona) OR COVID 
BioRxiv/MedRxiv: ncov or corona or wuhan or COVID 


Appendix 4. Search classification model 


We needed a more efficient approach to keep up with the rapidly increasing volume of COVID-19 literature. A classification model for 
COVID-19 diagnostic studies was built with the model building function within Eppi Reviewer, which uses the standard SGCClassifier in 
Scikit-learn on word trigrams. As outputs, new documents receive a percentage (from the predict_proba function) where scores close to 
100 indicate a high probability of belonging to the class ‘relevant document’ and scores close to 0 indicate a low probability of belonging 
to the class ‘relevant document’. We used three iterations of manual screening (title and abstract screening, followed by full-text review) 
to build and test classifiers. The final included studies were used as relevant documents, while the remainder of the COVID-19 studies were 
used as irrelevant documents. The classifier was trained on the first round of selected articles, and tested and retrained on the second 
round of selected articles. Testing on the second round of selected articles revealed poor positive predictive value but 100% sensitivity at 
a cut-off of 10. The poor positive predictive value is mainly due to the broad scope of our topic (all diagnostic studies in COVID-19), poor 
reporting in abstracts, and a small set of included documents. The model was retrained using the articles selected of the second and third 
rounds of screening, which added a considerable number of additional documents. This led to a large increase in positive predictive value, 
at the cost of a lower sensitivity, which led us to reduce the cut-off to 5. The largest proportion of documents had a score between 0-5. 
This set did not contain any of the relevant documents. This version of the classifier with a cut-off 5 was used in subsequent rounds and 
accounted for approximately 80% of the screening burden. 


Appendix 5. CDC Library, COVID-19 Research Articles Downloadable Database 
Embase records from the Stephen B. Thacker CDC Library, COVID-19 Research articles Downloadable database 


Records were obtained by the CDC library by searching Embase through Ovid using the following search strategy. 


Source Strategy 


Embase coronavir* OR corona virus* OR betacoronavir* OR covid19 OR covid 19 OR nCoV OR novel CoV OR 
CoV 2 OR CoV2 OR sarscov2 OR 2019nCoV OR wuhan virus*).mp. OR ((wuhan OR hubei OR huanan) 
AND (severe acute respiratory OR pneumonia*) AND outbreak*).mp. OR Coronavirus infection/ OR 
coronavirinae/ OR exp betacoronavirus/ 


Limits: 2020- 
OR 


(novel coronavir* OR novel corona virus* OR covid19 OR covid 19 OR nCoV OR novel CoV OR CoV 2 
OR CoV2 OR sarscov2 OR 2019nCoV OR wuhan virus*).mp. OR ((wuhan OR hubei OR huanan) AND 
(severe acute respiratory OR pneumonia*) AND outbreak*).mp. OR ((wuhan OR hubei OR huanan) 
AND (coronavir* OR betacoronavir*)).mp. 


Limits: 2019- 


Appendix 6. Data extraction items 
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Patient sam- 
pling items 


Al Purpose 


A2 Design 
(and descrip- 
tion of groups 
labelled [1] [2] 
saa) 


A3 Recruit- 
ment 


A4 Were cas- 
es recruited 
prospectively 
or retrospec- 
tively? 


A5 Sample 
size (virus/ 
COVID cases) 


AG Inclusion 
and exclusion 
criteria 


A7 Comment 


Patient character- 
istics and setting 
items 


B1 Setting 


B2 Location (in- 
clude name of insti- 
tution if available) 


B3 Country 


B4 Dates 


B5 Symptoms and 
severity 


B6 Demographics 


B7 Exposure history 


B8 Comment 


Non-COVID pa- 
tients (if additional 
groups) 

C1.1 Group name 
C1.2 Source and 


time 


C1.3 Characteristics 


C2.1 Group name 


C2.2 Source and 
time 


Index test items 


D1.1 Test name (please include 
product code if reported) 


D1.2 Manufacturer 


D1.3 Antigen or genetic target 


D1.4 Antibodies used 


D1.5 POC or laboratory 


D1.6 Test method 


D1.7 When were samples tak- 
en? 


D1.8 Samples used (include 
who collected by) 


D1.8.1 Transport media (vol- 
ume and manufacturer detail) 
D1.8.2 Sample storage and 


timing of test 


D1.9 Who applied the test (in- 
clude reported training/e)? 


D1.10 How was positive de- 
fined? 


D1.11 Blinded to reference 
standard 


D1.12 Threshold predefined 


Reference standard 
items 


E1 Reference stan- 
dard for cases includ- 
ing threshold 


E1.1 RT-PCR genetic 
targets 


E2 Samples used 


E3 Timing of refer- 
ence standard 


E4 Was it blind to in- 
dex test? 


E5 Did it incorporate 
index test? 


E6 Reference stan- 
dard for non-cases 


E7 Samples used 


E8 Timing of refer- 
ence standard 


E9 Was it blind to in- 
dex test? 


E10 Did it incorpo- 
rate index test? 


E11 Comment 


Flow and tim- 
ing items 


F1 What was 
the time inter- 
val between in- 
dex and refer- 
ence tests? 


F2 Did all pa- 
tients receive 
the same refer- 
ence standard? 


F3 Missing data 


F4 Uninter- 
pretable results 


F5 Indetermi- 
nate results (in- 
dex) 


F5.1 Indeter- 
minate results 


(reference) 


F6 Samples or 
patients 


F7 Comment 


Notes items 


G1 Funding 


G2 Publica- 
tion status 


G3 Source 
(preprint or 
journal name) 


G4 Study au- 
thor Col (in- 
cluding any 
manufacturer 
affiliations) 


G5 Comment 
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(Continued) 


C2.3 Characteristics D1.13 Comment 


Col: conflict of interest; POC: point of care; RT-PCR: reverse transcription polymerase chain reaction 


Appendix 7. Criteria for assessment of study quality (QUADAS-2) 


DOMAIN: Participant selection 


Was a consecutive or random 
sample of patients enrolled? 


Was a case-control design 
avoided? 


Did the study avoid inappro- 
priate exclusions? 


Did the study avoid inappro- 
priate inclusions? 


Could the selection of pa- 
tients have introduced bias? 


This will be similar for all index tests, target conditions, and populations. 


Yes: if a study explicitly stated that all participants within a certain time frame were included; that 
this was done consecutively; or that a random selection was done. 


No: if it was clear that a different selection procedure was employed; for example, selection based 
on clinician's preference, or based on institutions, or based on result of RT-PCR 


Unclear: if the selection procedure was not clear or not reported 


This will be similar for all index tests, target conditions, and populations. 


Yes: if a study explicitly stated that all participants came from the same group of (suspected) pa- 
tients. 


No: if it was clear that a different selection procedure was employed for the participants depending 
on their COVID-19 status or SARS-CoV-2 infection status; or if only participants with SARS-CoV-2 in- 
fection were included 


Unclear: if the selection procedure was not clear or not reported. 


Studies may have excluded patients, or selected patients in such a way that they avoided including 
those who were difficult to diagnose or likely to be borderline. Although the inclusion and exclu- 
sion criteria will be different for the different index tests, inappropriate exclusions and inclusions 
will be similar for all index tests: for example, only elderly patients excluded, or children (as sam- 
pling may be more difficult). This needs to be addressed on a case-by-case basis. 


Yes: if a high proportion of eligible patients was included without clear selection. 


No: if a high proportion of eligible patients was excluded without providing a reason; if, in a retro- 
spective study, participants without index test or reference standard results were excluded. 


Unclear: if the exclusion criteria were not reported. 


Some laboratory studies may have intentionally included groups of patients in whom the accura- 

cy was likely to differ, such as those with particularly low or high viral loads, or who had other dis- 
eases, such that the sample over-represented these groups. This needs to be addressed on a case- 
by-case basis. 


Yes: if samples included were likely to be representative of the spectrum of disease. 


No: if the study oversampled patients with particular characteristics likely to affect estimates of ac- 
curacy. 


Unclear: if the exclusion criteria were not reported. 


High: if one or more signalling questions were answered with no, as any deviation from the selec- 
tion process may lead to bias. 


Low: if all signalling questions were answered with yes. 





Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 346 
Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 


Collaboration. 


+‘ Cochrane 
tw Library 


Trusted evidence. 
Informed decisions. 
Better health. 


Cochrane Database of Systematic Reviews 





(Continued) 


Is there concern that the in- 
cluded participants do not 
match the review question? 


DOMAIN: Index tests 


Were the index test results 
interpreted without knowl- 
edge of the results of the ref- 
erence standard? 


If a threshold was used, was 
it prespecified? 


Could the conduct or inter- 
pretation of the index test 
have introduced bias? 


Is there concern that the in- 
dex test, its conduct, or in- 
terpretation differ from the 
review question? 


DOMAIN: Reference standard 


Is the reference standard 
likely to correctly classify 
the target condition? 


Unclear: all other instances 


High: for two-group studies that included healthy or other disease controls, whether pre-pandemic 
or contemporaneous; studies that only included people with COVID-19 (whether RT-PCR-confirmed 
only, participants meeting official guideline criteria); 


Low: for single-group studies recruiting participants with signs and symptoms of COVID-19; or for 
two-group studies where control groups suspected of COVID-19 were separately recruited. 


Unclear: if a description about the participants was lacking. 


Yes: if blinding was explicitly stated or index test was recorded before the results from the refer- 
ence standard were available. 


No: if it was explicitly stated that the index test results were interpreted with knowledge of the re- 
sults of the reference standard. 


Unclear: if blinding was unclearly reported. 


Yes: if the test was dichotomous by nature, or if the threshold was stated in the methods section, or 
if study authors stated that the threshold as recommended by the manufacturer was used. 


No: if a receiver operating characteristic curve was drawn or multiple threshold reported in the re- 
sults section; and the final result was based on one of these thresholds. 


Unclear: if threshold selection was not clearly reported. 


High: if one or more signalling questions were answered with no, as even in a laboratory situation 
knowledge of the reference standard may lead to bias. 


Low: if all signalling questions were answered with yes. 


Unclear: all other instances 


For all test types, if index test is 'in-house' or not commercially available, then state 'High', 

If any test procedures used in the study diverged from IFU ((use of VTM, or testing outwith stated 
time limit), also state High 

If testing carried out in centralised laboratory and not near patient then state High. 

Evaluations that withheld the name of the test, or that used mixed sample types or did not report 
the evaluation setting, state Unclear 

If samples used and any sample processing steps are in accordance with test IFU, or if study de- 
scribes conducting the test according to the manufacturer's protocol, state Low 


We will define acceptable reference standards using a consensus process once the list of reference 
standards that have been used has been obtained from the eligible studies. 


For COVID-19 cases 


Yes: RT-PCR; confirmed or suspected case using official criteria (WHO, CDC) or a clearly set out com- 
bination of signs/symptoms/exposure 


No: RT-PCR not used, or if inadequate combination of clinical characteristics used in PCR-nega- 
tives, e.g. computed tomography alone 


Unclear: if definition of COVID-19 was not reported 


For absence of COVID-19 
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Were the reference standard 
results interpreted without 
knowledge of the results of 
the index test? 


Did the definition of the ref- 
erence standard incorpo- 
rate results from the index 
test(s)? 


Could the conduct or inter- 
pretation of the reference 
standard have introduced 
bias? 


Is there concern that the tar- 
get condition as defined by 
the reference standard does 
not match the review ques- 
tion? 


DOMAIN: Flow and timing 


Was there an appropriate in- 
terval between index test 
and reference standard? 


Did all participants receive 
the same reference stan- 
dard? 


Were all participants includ- 
ed in the analysis? 


Yes: if at least 2 negative RT-PCR results reported if suspected COVID-19 based on signs/symptoms; 
single negative RT-PCR test for asymptomatic contacts or contemporaneous controls with no clini- 
cal suspicion of COVID-19; only pre-pandemic sources of control samples used. 


No: single RT-PCR or number of negative RT-PCRs not reported for COVID-19 suspects; no RT-PCR 
reported (untested) for asymptomatic contacts or contemporaneous controls 
Unclear: if timing of control samples (pre-pandemic or contemporaneous) was not reported 


Yes: if it was explicitly stated that the reference standard results were interpreted without knowl- 
edge of the results of the index test, or if the result of the index test was obtained after the refer- 
ence standard. 


No: if it was explicitly stated that the reference standard results were interpreted with knowledge 
of the results of the index test or if the index test was used to make the final diagnosis. 


Unclear: if blinding was unclearly reported. 


Yes: if results from the index test were a component of the reference standard definition. 
No: if the reference standard did not incorporate the index standard test. 


Unclear: if it was unclear whether the results of the index test formed part of the reference stan- 
dard. 


High: if one or more signalling questions were answered with no. 
Low: if all signalling questions were answered with yes. 


Unclear: all other instances 


Applicability was judged primarily on the definition of disease-positive. 
High: if RT-PCR alone used to define cases 


Low: if clinical criteria, including RT-PCR, were used to define cases, regardless of whether official 
criteria were used, as long as the criteria were explicitly described. 


Unclear: if definition of COVID-19 cases was not provided, including if some clinically diagnosed 
cases were included but the clinical criteria used were not described. 


Yes: if same swab used, or swabs obtained at same time regardless of freezing (which is covered 
under index applicability) 


No: if different samples used with more than 24 hours between collection times 


Unclear: if can't tell 


Yes: if all participants received the same reference standard (clearly no differential verification). 


No: if (part of) the index test-positives or index test-negatives received a different reference stan- 
dard. 


Unclear: if it was not reported 


Yes: if it is clear that all eligible participants were included in the analyses. 


No: if after the inclusion/exclusion process, participants were removed from the analyses for dif- 
ferent reasons: no reference standard done, no index test done, intermediate results of both index 
test or reference standard, indeterminate results of both index test or reference standard, samples 
unusable. 
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Did all participants receive a 
reference standard? 


Were results presented per 
participant? 


Could the participantflow 
have introduced bias? 


Unclear: if it is not possible to determine whether all participants were included (e.g. from a STARD- 
style participant flow diagram) 


Yes: if all participants received a reference standard (clearly no partial verification). 


No: if only (part of) the index test positives or index test negatives received the complete reference 
standard. 


Unclear: if it was not reported 


Yes: if either only one sample per participant (regardless of disaggregation of results over time), or 
if multiple samples per participant but results are disaggregated by time period (at least week by 
week) 


No: if multiple samples per participant and results are not disaggregated by time period 


Unclear: if it is not possible to tell whether results presented are per participant or per sample 


High: if one or more signalling questions were answered with no. 
Low: if all signalling questions were answered with yes. 


Unclear: all other instances 


CDC: Centers for Disease Control; ICU: intensive care unit; IFU: instructions for use; RT-PCR: real-time polymerase chain reaction; 
SARS-CoV-2: severe acute respiratory syndrome coronavirus 2; VTM: viral transport medium; WHO: World Health Organization 


Appendix 8. Excluded studies 


Study 


Studies 'almost' included 


Exclusion reason 


Notes Other review inclusion 


Basu 2020 Ineligible reference standard Assesses agreement between two POC tests —_ No; excluded 
FIND 2020f Superseded by Kruger 2020(a) — Coris Bioconcept data No; excluded 
McDonald 2020 Ineligible reference standard Only antigen negatives get RT-PCR No; excluded 


McCormick-Baw 
2020 


Mlcochova 2020 


Ineligible reference standard 


superseded by Collier 2020 


RT-PCR (including Xpert XPress) using alter- Sampling methods compar- 
native sample types ison 


SAMBA-II data (33 COVID cases; same re- 
cruitment dates 


No; excluded 


Studies excluded on index test technology 
Anahtar 2020 Ineligible index test 
Ar Gouilh 2020 Ineligible index test 
Arumugam 2020 Ineligible index test 


Azzi 2020 Ineligible index test 


in-house RT-LAMP; direct testing 
in-house RT-LAMP 
in-house RT-PCR; direct testing 


in-house RT-LAMP 


Technology comparison 
Technology comparison 
Technology comparison 


Technology comparison 
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Baek 2020 


Bokelmann 2020 


Bordi 2020 
Broughton 2020 
Chen 2020a 
Chow 2020 
Ding 2020a 
Dong 2020 
Fowler 2020 


Freire-Paspuel 
2020b 


Hirotsu 2020 
Hu 2020 
Huang 2020 
James 2020 
Jiang 2020 
Joung 2020 
Joung 2020a 
Lee 2020 

Lu 2020a 
Mohon 2020 


Newman 2020 


Osterdahl 2020 


Peto 2020 


Pollock 2020a 


Qian 2020 


Rauch 2020 


Ineligible index test 


Ineligible index test 


Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible index test 


Ineligible index test 


Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible index test 


Ineligible index test 


Ineligible index test 


Ineligible index test 


Ineligible index test 


Ineligible index test 


Ineligible index test 


in-house RT-LAMP 


Cap-iLAMP (capture and improved loop-me- 
diated isothermal amplification). 


One step RT-PCR; not suited to POC 
in-house CRISPR-Cas12 based assay 
CRISPR/Cas12a 

in-house RT-LAMP 

in-house RT-LAMP 

One-step RT-dPCR 

(direct) RT-LAMP 


compares two RT-PCR kits 


Automated RT-PCR; not suited to POC 
in-house RT-LAMP 

in-house Rt-LAMP 

in-house RT-LAMP 

in-house RT-LAMP 

SHERLOCK testing in one Pot 
in-house RT-LAMP 

in-house RT-LAMP 

in-house RT-LAMP 

in-house RT-LAMP 


in-house RT-LAMP used in mobile setting; 
sample prep includes centrifuge 


in-house RT-LAMP 


loop-mediated isothermal amplification and 
nanopore sequencing 


Laboratory-based Ag assay 


Fast isothermal Nucleid acid detection 
(FIND) assay (RT-RPA) 


CREST - CRISPr-Cas13a 


Technology comparison 


Technology comparison 


Technology comparison 
Technology comparison 
Technology comparison 
Technology comparison 
Technology comparison 
Technology comparison 
Technology comparison 


No; excluded 


No; excluded 

Technology comparison 
Technology comparison 
Technology comparison 
Technology comparison 
Technology comparison 
Technology comparison 
Technology comparison 
Technology comparison 
Technology comparison 


Technology comparison 


Technology comparison 


Technology comparison 


Technology comparison 


Technology comparison 


Technology comparison 
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Shirato 2020 


Singh 2020b 
Wang 2020a 


Wang 2020a 


Yan 2020 
Yang 2020b 
Yu 2020a 
Yu 2020b 


Yu 2020c 


Zhang 2020 


Zhu 2020 


Ineligible index test 


Ineligible index test 
Ineligible index test 


Ineligible index test 


Ineligible index test 
Ineligible index test 
Ineligible index test 
Ineligible index test 


Ineligible index test 


Ineligible index test 


Ineligible index test 


Intended for direct testing but used with ex- 


tracted RNA 


targeted-mass spectrometry 


RT-RAA assay 


CRISPR/Cas12a-based assay with a naked 


eye readout, CRISPR/Cas12a-NER 


in-house RT-LAMP 


in-house RT-LAMP 


in-house RT-LAMP 


in-house RT-LAMP (iLACO) 


LFA technology but sample requires PCR 


amplification step first 


(RT-LAMP) coupled with nanoparti- 


cles-based biosensor (NBS) assay (RT-LAMP- 


NBS) 


RT-LAMP with extracted RNA 


Technology comparison 


Technology comparison 
Technology comparison 


Technology comparison 


Technology comparison 
Technology comparison 
Technology comparison 
Technology comparison 


Technology comparison 


Technology comparison 


Technology comparison 


LFA: lateral flow assay; PCR: polymerase chain reaction; POC: point-of-care; RT-LAMP: reverse transcription loop-mediated isother- 
mal amplification; RT-PCR: reverse transcription polymerase chain reaction 


Appendix 9. Antigen tests: summary study characteristics 


Study 


Albert 2020 
Preprint 


412 (54) 


Alemany 2020 
Preprint 


Total N 1406 
(951 cases) 


Study design; inclu- 
sion criteria 


Single group (prospec- 
tive); clinical suspicion 
of COVID-19 (compati- 
ble signs or symptoms 
appearing within the 
prior week) 


Single group (not stat- 
ed); 


Samples from 


Setting; 
country (re- 
cruitment 
dates) 


COVID-19 test 
centre (prima- 
ry care); 


Spain 


(2 September 
to 7 October 
2020) 


Laborato- 
ry-based); 


Spain 


(Not stated) 


Participant char- 
acteristics 


Symptomatic: all < 
7 days pso 


median age, 31 


years (range, 1-91); 
42% male 


Mixed: 


No details; 15 
(1.1%) hospitalised 


Reference standard 
Reference samples and 
timing 

RT-PCR (single assay) 


Target: ORFlab, N and S 
genes 


NP inVTM 


Timing: as for index; test- 
ed within 24h 


Interval: simultaneous; 
paired 


RT-PCR (single assay) 


Target: not stated; as per 
CDC protocol 


Missing data or 
indeterminate 
results 


None reported 


Index: none re- 
ported 


Reference: none 
reported 


None reported 


Index: none re- 
ported 
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Libra ry Better health. Cochrane Database of Systematic Reviews 
(Continued) 
[1] 446 (419) [1] symptomatic in- Mean age 40.4 NP or nasal mid-turbinate; Reference: none 
[2] 473 (415) dividuals in routine years (SD 24.5),453 as per index test reported 
[3] 487 (117) practice (32.2% male) 
[2] contacts exposed Timing: fresh samples 
to confirmed case stored at 2-8 °C for up to 
[3] preventive screen- 72 h prior to RT-PCR 
ing of unexposed ' 
asymptomatic individ- Interval: simultaneous 
wale (same swab) 
Billaud 2020 Single group (prospec- Contacts Mixed: RT-PCR (single assay) 47 missing, in- 
; tive); cluster investiga- (screening); cluding 11 unin- 
Published tion at higher educa- 166/509, 32.6% Target: not stated terpretable on Ag 
tion institute France symptomatic test 
462 (99); 47 NP (paired) 
missing, pre- (September Mean, median age Index: none re- 
sumably with 16 and 17) Students 21.6 years, Timing: as for index ported 
no paired data 21 years (18-37 . 
years) Interval: simultaneous Beferancaenone 
Teachers 47.2 reported 
years, 49 years 
(26-64 years) 
Blairon 2020 Single group (prospec- _ Laborato- None reported RT-PCR (single assay) None reported; 
tive) ry-based main cohort ex- 
Published (swabs ob- Target: E gene cluded 
Samples sent forlabo- tained at hos- 
56 (30) ratory diagnosis pital site; no NP swabs (same asforAg None reported; 


further detail); 


test) 


Timing: not stated 


1 ‘invalid’ sam- 
ple excluded from 


Belgium main cohort 
(5 April-4 May ees fone oe butin- Index: none re- 
2020) CST EE IME Stves ported; reference: 
none reported 
Cerutti 2020 Single group (not stat- Mixed ((1) ED Mixed: not stat- RT-PCR (single assay) None reported 
ed); (2) Possible ed; cohort (2) were 
Published contacts); asymptomatic Target: not stated Index: none re- 
(1) symptomatic pa- ported 
330 (109) tients at lof 2EDs(n= __ Italy (1) mean age 44.6, Not stated 
185) 95%Ci40.7-486 ted Reference: none 
(2) asymptomatic trav-  ((1) 3 Mar-1 (2) mean age 35.9, as reported 
i Ma : = 
ellers returning from vee 95 % Cl: 32.7-39.1 Interval: simultaneous; not 
high-risk countries clear if same sample used 
2020) é : 
or paired swabs obtained 
Courtellemont Unclear; two group Mixed (COV- Mainly sympto- RT-PCR (single assay) None reported 
2020 (Unclear) ID testing matic (99/121 cas- 


unit and inpa- 


es) 


Target: ORFlab, S and N 


None reported 


Preprint (1) Symptomatic or tient); genes 
asymptomatic people median age 38 ; ; Index: none re- 
248 (121) voluntarily accessing France years, mean age 43. NP in VTM; paired ported 
the COVID-19 Screen- years (range: 18-96) Timing: as for ind Ref : 
ing Department (12 Oct-19 117 Hale iming: as for index . sag none 
(2) hospitalised SARS- oe Interval: simultaneous; 
CoV-2-positive pa- paired 
tients 
Diao 2020 Single group (retro- Unclear (not Not reported RT-PCR (single assay); Not reported 


spective) 


stated); 


Threshold < 40 Ct 
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(Continued) 

Preprint Samples from cases of China Target: ORFlab and N Index: nR 

(not peer re- suspected SARS-CoV-2 gene 

viewed) infection (not stated) Reference: none 
As for index test; NP swab reported 

239 (208) for 

nasopharyn- Timing: not stated 

geal swab; 20 


(19) for urine 


Interval: done in parallel 


Fenollar Single group (cases) COVID-19 test Symptomatic RT-PCR (single assay - Vi- None reported 
2020(a) (unclear) centre (un- No other details taPCR, Credo) 
clear; no de- Index: none re- 
Accepted [1] symptomatic, all tails); Target: not stated ported 
manuscript PCR+ 
France n/a Reference: none 
182 (182) Second cohort report- reported 
edinFenollar2020(b) (21 Septem- NP (paired, from opposite 
ber-2 October nostril) 
2020) Timing: not stated 
Interval: Paired swabs 
Fenollar Single group (unclear) Contacts(un- = Asymptomatic: RT-PCR (single assay - Vi- None reported 
2020(b) clear); taPCR, Credo) 
[2] asymptomatic con- No other details Index: none re- 
Accepted tacts of confirmed cas- France Target: not stated ported 
manuscript es 
(Sep 21-Oct 2 NP (paired, from opposite Reference: none 
159 (22) Second cohort report- 2020) nostril) reported 
ed in Fenollar 2020a 
Timing: not stated 
Interval: paired swabs 
FIND 2020a Single group (prospec- COVID-19test | Symptomatic; no RT-PCR (single assay); Reports 0 invalid 
tive) centre (com- further details Threshold < 37 Ct results 
published munity); 
Symptoms consistent mean age 40 years Target: N1, N2 None reported 
400 (102) with COVID-19 (meet- —_ Brazil (range 4-84) (n= 
ing national definition 396) NP swabs Index: none re- 
for testing) (30 July-21 181 (45%) male — ; ported 
August 2020) Timing: same as for index 
test Reference: none 
reported 
Interval: as per PCR turn- 
around time 
FIND 2020b Single group (prospec- COVID-19test | Symptomatic: RT-PCR (single assay); None reported 
tive) centre (com- Threshold <40 Ct (from 
published munity); 534/535 (99%) Figure) Index: none re- 
Presenting either with symptomatic ported 
535 (124) symptoms compati- Switzerland Target: not stated 
ble with SARS-CoV2, Mean age 38.5y Reference: none 
or known positive con- (9-16 Oct (16-85y) NP swab (paired, from reported 
tact orasymptomatic 2020) 247, 46% male contralateral nostril) 


HCW 


Timing: author contact ad- 
vises only paired swabs. 


Interval: as per PCR turn- 
around time 
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(Continued) 
FIND 2020c Single group (prospec- COVID-19test | Symptomatic: RT-PCR (single assay); Reports 0 missing 
(BR) tive) centre (com- Ct threshold not stated; data 
munity); 392/397 (99%);no author contact advises Ct 
published Ambulatory patients further details thresholds as per assay None reported 
meeting nationalsus- —_ Brazil IFUs 
400 (106) pect definition for mean age 37y (2-94) Index: none re- 
COVID-19 testing (13-30 Jul (397 participants); Target: N1 and N2 ported 
2020) 229/398 male (57%) 
NP swabs Reference: none 
reported 
Timing: author contact ad- 
vises only paired swabs 
used. 
Interval: as per PCR turn- 
around time 
FIND Single group (prospec- COVID-19test | Symptomatic: RT-PCR (single assay); None reported 
2020c(cH) tive) centre (com- Threshold < 40 Ct (from 
munity); Not stated; time Figure) Index: none re- 
published Patients seeking COV- pso recorded for ported 
ID-19 either with Switzerland 183/191, 96% Target: not stated 
529 (191) symptoms compati- 141/183 COVID-pos- Reference: none 
ble with a SARS-CoV2 (9-23 October itive cases had NP swab (paired, from reported 
infection, or witha 2020) symptoms for 0-4 contralateral nostril) 
RHooInipOStiive ae dave yer) Timing: author contact ad- 
tact or asymptomatic . ; 
HCWs Not stated vises only paired swabs 
used. 
Interval: as per PCR turn- 
around time 
FIND 2020d Single group (prospec- COVID-19test Mainly sympto- RT-PCR (multiple assays); Reports 0 missing 
(BR) tive) centre (com- matic: Author contact advises Ct data 
munity clin- thresholds as per assay 
published Adults in communi- ic or tertiary 421/450 (94%); no IFUs None reported 
ty meeting national hospital); further details 
453 (120) suspect definition for Target: 1. N1 and N2;2.E Index: none re- 
COVID-19 testing Brazil mean age 39 years = and RdRp ported 
(0-95 years) (451 
([1] 17 Aug-9 participants); 185 NP swabs Reference: none 
September [2] male (41%) reported 
11 Jul-8 Aug) Timing: author contact ad- 
vises only paired swabs 
used. 
Interval: as per PCR turn- 
around time 
FIND 2020d Single group (prospec- COVID-19test Mainly sympto- RT-PCR (multiple assays); Reports 0 missing 
(DE) tive) centre (com- matic: Author contact advises Ct data 
munity); thresholds as per assay 
published Adults in communi- 517/669 (77%); no IFUs None reported 
ty meeting national Germany further details 
676 (39) suspect definition for Target: not stated apart Index: none re- 
COVID-19 testing pre- _([1] Heidel- mean age 38 years ~— from 3. E gene ported 
senting at berg: 15 (18-85 years) (676 
[1] a drive-in testing June-18 July participants); 307 NP (n = 305), NOP (n=342) Reference: none 
centre or 2020 male (46%) and/or OP swabs (n = 32) reported 
[2] ambulatory testing [2] Berlin: 
clinic 6 July-23 
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(Continued) 
September Timing: author contact ad- 
2020) vises only paired swabs 
used. 
Interval: as per PCR turn- 
around time 
FIND 2020e Single group (prospec- COVID-19test | Symptomatic: RT-PCR (single assay); Reports 0 missing 
(BR) tive); centre (com- Ct threshold not stated data 
munity); 470/476 (99%) 
published adults in communi- symptomatic; no Target: N1 and N2 None reported 
ty meeting national Brazil further details 
476 (117) suspect definition for NP swabs Index: none re- 
COVID-19 testing (27 Jul-16 mean age 45 years a ported 
Sep) (0-106 years) (473 Timing: author contact ad- 
participants); 252 vises only paired swabs Reference: none 
male (53%) used. reported 
Interval: as per PCR turn- 
around time 
FIND 2020e Single group (prospec- COVID-19test Mixed: RT-PCR (multiple assays) Reports 0 missing 
(DE) tive) centre (com- Author contact advises Ct data 
munity); 1733/1223 (59.9%) thresholds as per assay 
published Adults in communi- symptomatic; no IFUs None reported 
ty meeting national Germany further details 
1239 (25) suspect definition for Target: not stated Index: none re- 
COVID-19 testing ([1] Heidel- mean age 39.5 ported 
berg:4May-3 years (17,59.2 NP swabs 
September [2] years) (1239 partic- Reference: none 
Berlin:4 May- _ipants); 607 male Timing: author contact ad- reported 
18 Aug) (50%) vises only paired swabs 
used. 
Interval: as per PCR turn- 
around time 
Fourati 2020 Two group (retrospec- — Laborato- Symptomatic RT-PCR (single assay) Number of cases 
[A] tive) ry-based (un- missing per assay 
clear; "con- No further details Target: not stated varied; reasons for 
Published (1) residual samples sulted or were : missing data not 
son from participants with admitted"); Not stated NP; same as for index reported (presum- 
; positive SARS-CoV-2 ae . ably invalid assa 
number of PCR tested when they — France Tiihigeassenindex aie y 
casessested presented symptoms Interval: same swab; si- [A] 5, 1.7% 
varied peras- (2) pre-pandemicsam- (9 March-9 [B] 6, 2.0% 
es April 2020) multaneous » 2.0% 
y ples p [C] 2, 0.7% 
[D] 0 
[E] 2, 0.7% 
[F] 0 
Not stated 


Index: not stated 


Reference: not 


stated 
Gremmels Single group (prospec- COVID-19test Mainly sympto- RT-PCR (single assay) 2 patients exclud- 
2020(a) tive) centre (com- matic ed (‘inappropriate 
munity) Target: E-, N-, and RdRP- application of NP 
Preprint [1] communi- Cohort [1] only.Da- gene swab and lab mis- 


ty-dwelling mildly 


Netherlands 


ta on symptoms 
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(Continued) 
[1] 1369 (139) 


Gremmels 
2020(b) 


Preprint 
[2] 208 (63) 


Gupta 2020 
Published 


330 (77) 


Kruger 2020(a) 


Kruger 
2020(b) 


Kruger 2020(c) 


Preprint 


symptomatic partici- 


pants in a medium en- 


demic area 


Second cohort re- 
ported in Gremmels 
2020(b) 


Single group (prospec- 


tive) 


[2] Communi- 
ty-dwelling mildly 
symptomatic partic- 
ipants in a high en- 
demic area 


Second cohort re- 
ported in Gremmels 
2020(a) 


Single group (not stat- 


ed; appears prospec- 
tive); 


meeting Indian Coun- 
cil of Medical Re- 
search (ICMR) strate- 
gy for COVID-19 test- 
ing (symptomatic or 
asymptomatic con- 
tacts between 5 and 
10 days of exposure) 


Single group (prospec- 


tive) 


Participants at risk for 


SARS-CoV-2 infection 
based on exposure to 


a confirmed case, sug- 


gestive symptoms, or 
travel to a high-risk 


[1] 22 Septem- 
ber-6 October 


COVID-19 test 
centre (com- 
munity); 


Netherlands 


[2] 23 Septem- 
ber-9 October 


COVID-19 test 
centre (outpa- 
tient; tertiary 
care hospital) 


India 


(31 May-24 Ju- 
ly 2020.) 


COVID-19 test 
centre or sec- 
ondary care 
(in-patient?) 


(1), (2) Ger- 
many 
(3) UK 


were missing from 
nine participants 
Asymptomatic 

37, 2.7%, sore 
throat 907, 66.3%; 
coryza 943, 69%; 
cough 780, 57.1%; 
headache 601, 
44.0%; tiredness 
565, 41.3%; general 
malaise 365, 26.7% 
(further 19 docu- 
mented) 


median age 36.4 
years (IQR 27.0, 49.6 
years); 523, 38.3% 
male 


Not reported 


Not stated; 'mildly 
symptomatic’, pre- 
sume mixed as per 
Gremmels 2020(a) 


Not stated 


Mixed 


204 (62%) sympto- 
matic; 126 (38%) 
asymptomatic. 
Median symp- 
tom duration: 1 
day (range: 1-10). 
Symptoms includ- 
ed: fever (31.5%), 
cough (25.4%), 
fatigue/malaise 
(11.8%), headache 
(3.3%), runny nose 
(3.3%) 


Median age 34.1 
+ 12.6 years; 231 
(70%) male 


Mainly sympto- 
matic 


Symptomatic on 
testing day (n= 
2355) 

Overall: 1901, 
80.7% 

[A] 564, 81.2% 
[B] 283, 68.9% 


NOP (paired) 


Timing: NOP swab ob- 
tained first for RT-PCR 


Interval: paired 


RT-PCR (single assay) 


Target: E-, N-, and RdRP- 
gene 


NOP (paired) 


Timing: NOP swab ob- 
tained first for RT-PCR 


Interval: paired 


RT-PCR (single assay) 
Target: ORF1 ab 


nasal and throat swabs 
(NOP) in VTM 


Timing: as for index test; 
sequence for specimen 
collection was random for 
both the samples 


Interval: paired swabs 


RT-PCR (multiple assays) 
Target: not stated 


Paired swabs; as per in- 
dex test (RT-PCR swab ob- 
tained first) 

Drive-in centre: NP or OP 
Other centres: combined 
NOP (OP conducted first) 


labelling’), dis sta- 
tus not reported. 


None reported 


Index: none; no 
bands were classi- 
fied as unclear 


Reference: pa- 
tients 


None reported 


Index: none; no 
bands were classi- 
fied as unclear by 
the independent 
observers 


Reference: none 


None reported 


Index: none re- 
ported 


Reference: none 
reported 


154 excluded fol- 

lowing enrolment 
[116 2nd swab re- 
fused 

3 nose bleed after 
1st swab 

3 insufficient time 
for both swabs 

31 other reasons 
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(Continued) 
Overall: 2407 area, presenting at 1 (17 April and [C] 1054, 84.4% Timing: as per index test 1 no reason avail- 
(70) of 3 sites: 25 August Prior negative test able] 
By assay: (1) drive-in testing sta- | 2020; dates result (n = 1928) Interval: paired; simulta- 
[A] 729 (15) tion (n= 1213) varied by as- Overall: 236,12.2% neous Antigen tests: 
[B] 425 (8) (2) a clinical ambula- say and site) [A] 73, 11.7% [A] 2 invalid (PCR- 
[C] 1263 (47) tory testing facility (n [B] 38, 12.6% negative) 
SD Biosensor = 1308) [C] 125, 12.5% [B] 8 invalid (PCR- 
data (assay (3) secondary care fa- Detailed symptoms negative) 
[C]) can also cility (n = 53) are reported by site [C] 0 invalid re- 
be extracted and test in supple- ported 
by site mentary materials PCR: 3 excluded as 
(1) 334 (7) invalid (n = 2) or 
(2) 907 (39) Mean age (SD) (n= not available (n = 
(3) 19 (0) 2405) 1) 
Overall 40.4 years 
(14.3) Index: none re- 
[A] 42.7 (14.9) ported 
es A oes Reference: none 
Male (%) (n = 2361) reper? 
Overall: 1115, 
47.2% 
[A] 47.2% 
[B] 39.7% 
[C] 49.8% 
Lam- Single group (unclear; — Laborato- Not reported RT-PCR (multiple assays) 4 samples collect- 
bert-Niclot testing conducted ry-based (3 ed in COBAS VTM 
2020 prospectively); university Target: E gene gave invalid re- 
hospital virol- . sults and all sam- 
Accepted Samples submitted for ogy laborato- As for index test; NP swab ples in COBAS 
manuscript RT-PCR testing ries); Tiwi sewithinatew hours medium were ex- 
138 (94) Piece after collection cluded 
me Interval: same sample, Index: control 
aed both tests conducted with- a Hal ella as 
ina few hours arely visible' for 
9 positive and 8 
negative tests 
Reference: none 
reported 
Linares 2020 Single group (un- Hospital A&E Mixed: RT-PCR (single assay); None reported 
clear; appears to be (n = 135) or Threshold not stated however 257 re- 
Preprint prospective) primary care 185, 72% sympto- ported in Methods 
(n= 50); matic Target: not stated and 255 in Results 
255 (60); NB 2 locations: ED (n = 135): fever 
257 reported [1] symptomatic pa- Spain 40, dyspnoea 42, P (paired) None reported 
insamplecol- tients admitted to ED cough 22, headache a 
lection with clinical suspicion (10-15 14 Timing: not stated Index: none re- 
of COVID-19 (n = 135) September) Prim care (n = 50): ported 


or asymptomatic pa- 
tients with history of 
contact with another 
COVID-19 patient (n = 
17) 

[2] symptomatic 
patients (n = 50) or 
asymptomatic (n = 55) 
patients attending one 


fever 14, dysp- 
noea 1, cough 18, 
headache 17 


Mean(?) age 
(range): ED 51.5 
years (37.0-71.8 
years); primary 
care 39.0 years 
(25.0-56.0 years) 


Interval: paired 


Reference: none 
reported 
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(Continued) 
of two primary health- Male: ED 77 (51%), 
care centres primary care 49 
(47%) 
Liotti 2020 Unclear; two group Laborato- Not reported RT-PCR (multiple assays) None reported 
(retrospective) ry-based (not 
Published let- reported) Not stated Target: not stated Index: none re- 
ter Residual samples se- Of SARS-CoV-2-pos- ported 
lected from one of two _ Italy itive samples, 21, NP (same as index) FP results were 
329 (104) virology laboratories 20% high viral load aus re-tested with Ag 
at two COVID-19 refer- (not stated) (< 25 Ct), 83, 80% Timing: not stated assay, 3 of 4 re- 
ence hospitals low viral load (2 25) intenvalesimultaneous mained positive 
[28, 27% with Ct = (same swab) (all blood contam- 
35] inated) 
Not stated Reference: none 
reported 
Mak 2020 Single group (cases) Laborato- Not reported RT-PCR (single assay); None reported 
(retrospective) ry-based (not Threshold < 40 Ct 
Published stated) Not stated Index: none re- 
RT-PCR-positive sam- High viral load (< Target: RdRp ported 
160 samples ples selected from Hong Kong 18.57 Ct) - 64, 40% 
from 152 pa- Hong Kong's COVID-19 'Normal' viral load NPA & TS, NPS & TS, spu- Reference: none 
tients (160) reference laboratory (1 February-21  +1857-96, 60% tum and throat saliva, as reported 
April 2020) for index test 
Not stated 
Timing: not stated 
Interval: simultaneous; 
same samples 
Mertens 2020 Single group (retro- Laborato- Not reported RT-PCR (multiple assays) No 
spectively) ry-based (uni- Threshold < 40 Ct 
Preprint versity labo- Not reported None reported 
(not peer-re- Samples from cases of ratory; discus- Target: multiple 
viewed) suspected SARS-CoV-2 sign states no Index: weak T 
infection outpatients) As for index test lines considered 
n=328 sam- positive 
ples (99 at Belgium Timing: analysed at time 
LHUB-ULB, of collection Reference: none 
132 at CHU (19-30 March reported 
Liage, 97 at UZ 2020) Interval: same samples 
Leuven); 132 toed discussion report 
COVID-19 cas- some delay between PCR 
and antigen testing 
es 
Nagura-lkeda Single group (cas- Mixed (in- Mainly sympto- RT-PCR (no details) Not stated 
2020 es) (NR; samples ap- patient and matic 


pear to be collected 


asymptomatic 


Target: not reported 


None reported 


Accepted rospectivel admitted or 88 (85%) sympto- 

manuscript ae y) eae matic, including NP or OP; appears to be Index: none re- 
Patients with labora- 16 (15%) severe same day as saliva collec- ported 

103 (103) tory-confirmed COV- Japan (showing clinical tion 
ID-19 referred for iso- symptoms of pneu- ro ae References none 
lation andtreatment, (11 Febru- monia - dyspnea, Timing: specific timing in reported 
including sympto- ary-13 May tachypnoea, sat- regard to symptom onset 
matic and asympto- 2020) uration of percu- ne 


matic 


taneous oxygen 
[SpO2] < 93%, and 
the need for oxygen 


Interval: unclear; saliva 
collected on day of admis- 
sion to quarantine/hospi- 
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(Continued) 


Nash 2020 
Preprint 


190 (100) 


PHE 2020(a) 
Published 


1118 (178) 


PHE 2020(b) 
Published 


157 (46) 


PHE 2020(c) 
[non-HCW 
tested] 


Published 


Unclear; two group 
(retrospective) 


Samples from 
suspected pa- 

tients submitted to 
‘PATH' (ww.path.org) 
for routine COVID di- 
agnosis 


Two group (retrospec- 
tive) 


Residual swabs from 
[1] PCR+ in-patients (n 
= 200, all frozen) 


[2] PCR- inpatient (n 
= 1000, all fresh sam- 
ples) 

Swabs were sent to 
Porton Down follow- 
ing routine testing 


Single group (retro- 
spective) 


Samples obtained 
during a COVID-19 
outbreak at a navy 
barracks (n = 157) 


Single group (not stat- 
ed) 


Individuals presenting 
at a regional COVID-19 
testing centre 


therapy); 15 (15%) 
asymptomatic 


IPD provided 
Median age 46, 
range 18-87; 66 


(64%) male 
Laborato- Not reported 
ry-based 

Not reported 
Not reported 


(not reported) 


Inpatient Symptomatic 
UK 


(March 2020 
(PCR+)) 


Contacts (out- 
break); 


Not reported 


UK 


(Not stated) 


COVID-19 test Not reported; pre- 


centre sumably sympto- 

matic and meeting 
UK testing criteria 
(Not stated) 


tal but NP/OP conducted 
prior 


RT-PCR (single assay) 


Target: N, S,and ORFlab 
genes 


Nasal (same swab) 
Timing: not stated 


Interval: simultaneous 
(same swab) 


RT-PCR (may be Roche as- 
say) 


Target: not stated 


Appears to be same sam- 
ple as for Ag test 


Timing: as for index test 


Interval: same swab 


RT-PCR (unclear, may be 
Roche Cobas assay) 


Target: unclear 


Appears to be same sam- 
ple as for Ag test 


Timing: as for index test 


Interval: same swab 


RT-PCR (appears to be 
Roche assay) 


Target: not stated 


None reported 


Index: none re- 
ported 


Reference: none 
reported 


See below, plus 1 
void PCR 


Failure rates re- 
ported as: 

[1] 12/212, 6% 

[2] 50/1040, 5.1% 
NB remaining 
samples per group 
(200 and 990) does 
not match with fi- 
nal numbers re- 
ported (178 and 
940), no explana- 
tion given in re- 
port 


Index: unclear 


Reference: unclear 


None reported 


Failure rate re- 
ported as 6/157, 
3.8% 

NB resulting num- 
ber samples (n 

= 151) does not 
match with final 
number reported 
(n = 152) 


Index: unclear 


Reference: unclear 


Initial sample of 
1946 reported, 

27 failed and PCR 
with void PCR. Da- 
ta reported for on- 
ly 1686 
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(Continued) 
1946 (372) Not stated; paired swabs Failure rate re- 
obtained ported as 27/1946 
failed, 1.4% 
Timing: as for index test 
Index: unclear 
Interval: paired swabs; si- 
multaneous Reference: unclear 
PHE 2020(d) Single group (cases) COVID-19 test — Mainly sympto- RT-PCR (may be Roche HCW tested: 267 
[HCW tested] (not stated) centre (14 matic; 40/421 Cobas assay) reported, 27 
NHS test and (9.5%) asympto- failed, leaving 240 
PHE 2020(d) Individuals present- trace centres; matic, 59 (14%) Target: not stated for inclusion how- 
[Lab tested] ing at one of 14 dri- nofurtherde- with no data, ; ever data for on- 
ve-through region- tails); 322/421 with > 1 Not stated; combined NOP |, 553 HCW tested 
Published al COVID-19 NHS test symptom record- Swabs in IM samples are pro- 
479 (479) and trace centres. UK ed. Unclear ifsymp- timing: as for index test vided lab scientist 
Those with a PCR +ve toms were present tested: Initial sam- 
result returned fora (not stated) at the time of the Interval: unclear, may ple of 212 report- 
re-test within 5 days 1st swab or at the have been paired ed, 9 failed, leav- 
of the original result. time of the 2nd ing 203 for inclu- 
It appears that only sampling; data sion however da- 
those with PCR +ve for asymptomatic ta for only 198 lab 
results at the second group therefore not scientist tested 
sampling were includ- included in analy- samples are pro- 
ed. ses vided. 
[A] HCW tested NB: text reports da- Index: unclear 
ta for 41 asymp- 
[B] Lab scientist tested toniatic as ae Reference: unclear 
symptomatic from 
the Phase 3b study 
(total n = 385) 
PHE 2020(e) Single group (not stat- | Screening Asymptomatic RT-PCR (may be Roche as- _ Initial sample of 
ed) say) 570 reported, 36 
Published UK failed, leaving 534 
PHE and hospital staff Target: not stated for inclusion. Data 
538 (0) volunteering for test- (not stated) for 538 included 
ing Not stated; paired swabs 
obtained Failure rate re- 
Timing: as for index test als gett 20S: 
Interval: paired swabs; si- ldexsctene 
multaneous 
Reference: unclear 
Porte 2020a Single group (retro- Hospital A&E Symptomatic RT-PCR (single assay); No 
spectively) (private hospi- Threshold s 40 Ct 
Preprint tal emergency Cough 94 (74.6%) Not reported 
(not peer re- Patients with respira- room); Fever 77 (61.1%) Target: not stated 
viewed) tory symptoms and/or Median duration of Index: not report- 
feverandanepidemi- Chile symptoms of2days Asforindextest;sameOP ed 
127samples; _ logical risk factor for (IQR 1-4) (range and NP swabs used 
82 PCR posi- SARS-CoV-2 infection (16-21 March 0-12) — ; Reference: al 
tive (travel or contact with 2020) Duration of symp- Timing: median 2 d pso ents 


case) 


toms 

Day 0-3 91 (72.2%) 
Day 4-7 27 (22.4%) 
Day =88 (6.3%) 


68 male (53.5%) 


(IQR 1-4, range 0-12) 


Interval: same sample 
used; within 48 h 
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(Continued) 
median age 38 
years (IQR 29.5-44) 
(range 1-91) 
Porte 2020b Multi-group (retro- COVID-19 test Symptomatic RT-PCR (single assay) None reported 
[A] spective) centre (pri- Threshold < 40 Ct 
vate clinic) Not reported; 12 Index: none re- 
Accepted (1) COVID-19 patients asymptomatic Target: not stated ported 
manuscript presenting within 5 Chile 
days of symptom on- Total sample NOP; as for index test Reference: none 
64 (32) set (n= 32) (Not stated) Median age 39 years reported 
(2) symptomatic pa- (IQR 36.7-57); 33, Timing: not stated 
tients with negative panemals Interval: simultaneous; 
PCR (n = 20) . same sample 
(3) asymptomatic pa- 
tients screened prior 
to surgery (n = 12) 
Schildgen Two group (not stated; Unclear (not Mixed RT-PCR (single assay) 8 PCR invalid sam- 
2020 [A] presume retrospec- stated) ples also tested; 
tive) Not stated for BAL Target: not stated 2/8 invalid in one 
preprint Germany samples, throat AG assay each, 3/8 
[1] RT-PCR positive wash from 23 symp- BAL or throat wash; as per negative in all 3 Ag 
73 (42) BAL or throat wash (Not stated) tomatic and 27 index test assays 
samples asymptomatic peo- a 
[2] RT-PCR-negative ple Timing netstaes None reported 
ca Not stated Interval: same swab Index: none re- 
ported 
Reference: none 
reported 
Scohy 2020 Single group (not stat- | Laborato- Mixed RT-PCR (single assay) None reported 
ed) ry-based (un- Threshold < 40 Ct 
Published clear) 86 (58%) sympto- Index: none re- 
NP swabs submitted matic, 45 (30%) Target: RdRp ported 
148 (106) for testing at a large Belgium asymptomatic, 17 
tertiary hospital (11%) symptom sta- NP; same as for index Reference: none 
(6-21 April tus not reported ded reported 
2020) Median age 57.5 (0, Timing: not stated 


Shrestha 2020 


Single group (not stat- 
ed; appears prospec- 


Contacts (con- 
tact tracing) 


94 years); 64 (43%) 
male 


Asymptomatic 


Interval: same sample 


RT-PCR (no details) 


None reported 





Published tive) All asymptomatic; Target: not stated Index: tests were 
Nepal tested on day 5 ; repeated for sam- 

113 (47) Close contacts of con- NP in 3mLVTM ples with 

firmed cases identi- (Au- Range 13-74; 89, a ; indistinct out- 

fied through contact gust-Septem- 79% male Timing: as for index test comes. 

j idi ber 2020 
tracing, and residing ) Interval: simultaneous, Ref . 
in quarantine centre aired aamulas ererence: none 
p P reported 

Takeda 2020 Two group (retrospec- — Laborato- Not reported RT-PCR (single assay) 16 positive sam- 

; tive) ry-based (mul- ples omitted; pos- 
Preprint tiple clinical Not stated Target: N2 sibly because not 
exe [1] RT-PCR-confirmed institutions) sie actoniadenied: initial samples but 

(62) COVID-19 samples aa unclearly reported 
neren Timing: not stated 
Ie Menara None reported 
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(Continued) 
[2] Random sample of ("Early April" Interval: simultaneous, Index: none re- 
RT-PCR-negative sam- _ also later same samples ported 
ples states 4 day 
period) Reference: none 
reported 
Van der Mo- Single group (prospec- COVID-19test | Symptomatic RT-PCR (multiple assays) 2 samples exclud- 
eren 2020(a) tive) centre (com- ed due to RT-PCR 
munity) No details Target: E-and RDRP-gene — coding error 
Preprint [1] Adults presenting (Cobas) or 
atasinglecommuni- _— Netherlands Day <7 12, 70.6%, E-gene and N-gene (Ab- 1 invalid on Ag test 
354 (17) ty test centre for COV- Day>71,5.9%,not hott) 
ID-19 testing (28-30 reported 4, 23.5% Index: none re- 
September) NOP; specimen from the ported 
Second cohort report- throat and nasal cavity up 
ed in Van der Moeren to the nasal bridge Reference: none 
2020(b) reported 
Timing: as for index test 
Interval: paired 
Van der Mo- Single group (cases) COVID-19 test Symptomatic RT-PCR (multiple assays) Review team ex- 


eren 2020(b) 


(prospective) 


centre (com- 


cluded 7 no longer 


munity) At time of home vis- Target: E- and RDRP-gene PCR+ at time 
Preprint [2] Patients with a it: asymptomatic or of home visit (1 
positive PCR test re- Netherlands 3, 2% (2/3 still PCR E and N-gene asymptomatic 
132 (132) sult at one of 2 com- +ve) (antigen test pos- 
munity testing facili- (28 Septem- Symptomatic 129 NOP; specimen from the itive), 6 sympto- 
ties who were retested  ber-6 October) (123 still PCR +ve) throat and nasal cavityup atic (antigen 
at home within 72 h of Day <7 66, 50% to the nasal bridge test result not giv- 
initial positive result Day > 7 57, 43% a . 
, . : Timing: as for index test en) 
Second cohort report- Not stated 
ed in Van der ee Interval: paired ee 
2020(a) Index: none re- 
ported 
Reference: none 
reported 
Veyrenche Two group (retrospec- _—_ Hospital in- Symptomatic: RT-PCR (single assay) None reported 
2020 tive) patient (no 
further detail); All hospitalised; Target: RdRp, N, E Index: none re- 
Preprint [1] PCR+ hospital inpa- 27/45, 60% cases ; ported 
tients ( France ‘severe’ according NP; as for index 
65 (45) [2] Pre-pandemic to WHO guideline eee eer Reference: none 
samples from 'pa- (14March-11 (similar numbers AMINES eTOnINGEY reported 
eae otherwise April) per Ct subgroup) Interval: simultaneous; 
specifie 
Median age: same swab 
Ct < 25 66 years (IQR 
48-84) 
Ct 25-35 63 years 
(50-76) 
Ct 235 58 years 
(49-67) 
Controls 64 (35-93) 
32/45, 71% male, all 
controls were male 
Weitzel 2020 Single group (retro- Hospital A&E Symptomatic RT-PCR (single assay) 2 invalid excluded 
[A] spective) (emergency Threshold < 40 Ct 
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(Continued) 
Preprint 


111 (80) 


Young 2020 
Preprint 


251 (38); 9 ex- 
cluded 


Patients with respira- 
tory symptoms and/or 
fever 


Single group (prospec- 
tive) 


> 1 symptoms of COV- 
ID-19 (within < 7 days 
post symptom onset) 
at 21 study sites 


Second cohort exclud- 
ed as only discrepant 
results on the two Ag 
assays underwent RT- 
PCR 


room at pri- 
vate hospital); 


Chile 


(16 March-26 
April 2020) 


Mixed (dri- 
ve-through/ 
tent (n = 42), 
outpatient 
clinic (n = 74), 
research clin- 
ic (n= 72), or 
skilled nurs- 
ing facility (n= 
66)) 


USA 


(5-11 June 
2020) 


Respiratory symp- 
toms and/or fever; 
no further detail 


Median age 40 
years; 50, 45% male 
(median age 38 
years, 43% male for 
all samples tested 
during period) 


Symptomatic 


110 (43%) cough, 
98 (39%) mus- 

cle pain, 95 (37%) 
headache, 90 (35%) 
sore throat, 78 
(31%) fever. 

Of those at < 6 days 
pso (n= 245): 94 
(38%) with 1 symp- 
tom, 151 (62%) with 
22 symptoms 


median age 43 
(range 18-90); 91 
(36%) male 


Target: RdRp 
as for index; NOP swabs; 


Timing: as for index test; 
median 2 days (IQR 1-5 
days) 


Interval: same samples; in- 
dex tests conducted after 
frozen storage 


RT-PCR (single assay) 


Target: not stated 


NP (n= 217) or OP (n= 34); 
clinician collected 


Timing: swabs taken prior 
to any study swabs (poten- 
tial for contamination of 
nasal cavity) 


Interval: simultaneous 
(paired) 


Two tests invalid 
due to insufficient 
liquid migration 


Index: none re- 
ported 


Reference: none 
reported 


9 excluded; 6 did 
not meet eligibil- 
ity criteria and 3 
had invalid speci- 
mens/results (2 on 
RT-PCR and 1 la- 
belling error) 


3 invalid on at 
least one assay 


Index: none re- 
ported 


Reference: none 
reported. Re-test 
of 9 'FN' results 
with BD MAX RT- 
PCR resulted in 

2 confirmed FN 
(BD MAX +ve and 
sero t+ve), 6 were 
BD Max -ve (incl 1 
sero +ve) and 1 in- 
valid (no result) 


A&E: accident and emergency; BAL: bronchoalveolar lavage; CDC: National Health Commission of the People's Republic of China; Ct: 
cycle threshold; ED: emergency department; FP: false positive; HCW: healthcare worker; IFU: [manufacturers'] instructions for use; 
IPD: individual patient data; IQR: interquartile range; NHS: National Health Service (UK); NOP: naso-oropharyngeal; NP: nasopharyn- 
geal; OP: oropharyngeal; pso: post-symptom onset; RT-PCR: reverse transcription polymerase chain reaction; SD: standard devia- 
tion; VTM: viral transport medium 


Appendix 10. Antigen tests: summary index test details 


Study 


Albert 2020 


Index test (manu- 
facturer) 


Panbio COVID-19 AG 

Rapid Test Device (no 
product code report- 
ed) (Abbott Diagnos- 
tic GmbH, Jena, Ger- 
many) 


Test method 
Target 


CGIA (from IFU) 


Nucleoprotein 


Sample details 


Samples tested: NP; collected by trained 
nurses using flocked swabs (Direct) 


Timing of sampling: day <7 pso 


Timing of test: immediate testing 


Storage: none 


Test operator 
Test threshold 


Not stated 


Threshold: visible 
line within 15 min; 
as per manufac- 
turer 
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Alemany 2020 


Billaud 2020 


Blairon 2020 


Cerutti 2020 


Courtellemont 
2020 


Diao 2020 


Panbio COVID-19 
Ag Test (no product 
codes) 


(Abbott Laborato- 
ries) 

[Selected from com- 
parison of 4 assays 
using 40 NP samples] 


ABBOTT SARS-COV2 
Antigenic Test (Ab- 
bott) (no product 
code reported) 


COVID-19 Ag Respi- 
Strip (no product 
code reported) (Coris 
Biocencept (Gem- 
bloux, Belgium)) 


STANDARD Q COV- 
ID-19 Ag (SD-Biosen- 
sor, RELAB, I) (no 
product code report- 
ed) 


COVID-VIRO® (AAZ, 
Boulogne Billan- 
court, France) (no 
product code report- 
ed) 


Not stated (in-house) 


CGIA 
Not stated 


(SARS-CoV-2 
antigen) 


CGIA (from IFU) 


Not stated 


LFA 


Not stated 


CGIA (from IFU) 


NP 


CGIA 


Nucleocapsid 


FIA 


Nucleocapsid 
protein (N-anti- 
gen) 


Samples tested: varied by site [1] and [2] NP, 
[3] nasal mid-turbinate (VTM); collection not 

reported 

Timing of sampling: not stated (SARS-CoV-2 
antigen) 


Timing of test: not stated; frozen samples 


Storage: stored at 2-8 °C prior to PCR then 
frozen (-80 °C) prior to Ag testing 


Samples tested: NP; collected by firefighters 
(direct) 


Timing of sampling: not stated, includes 
people > 7 days pso 


Timing of test: immediate testing 


Storage: none 


Samples tested: NP swabs; collection not re- 
ported (VTM) 


Timing of sampling: not stated; appears to 
be on presentation (repeat tests ordered at 
clinician's discretion were excluded) 


Timing of test: infer that Ag test conducted 
immediately on receipt of sample at on-site 
laboratory 


Storage: no storage described 


Samples tested: NP; collection not stated 
(VTM) 


Timing of sampling: not stated 
Timing of test: not stated 


Storage: primarily run in parallel with stan- 
dard of care RT-PCR; 13 were frozen residual 
samples 


Samples tested: NP; collected by trained per- 
sonnel (nurse, 

doctors, or biologist) 

Subgroup had OP or saliva collected (direct) 


Timing of sampling: median 5 days pso, 
mean 5.3 days, range 1-20 d 


Timing of test: immediate testing 


Storage: none 


Samples tested: NP (all), urine (subgroup) 
(saline) 


Timing of sampling: not stated 


Timing of test: not reported 


2 laboratory tech- 
nicians 


Threshold: visible 
line; as per manu- 
facturer 


Not stated 


Threshold: visual 
line; as per manu- 
facturer 


Not stated; infer 
laboratory staff 


Threshold: as per 
manufacturer 


Not stated; labo- 
ratory staff pre- 
sumed 


Threshold: visu- 
al line after 15-30 
min; as per manu- 
facturer 


Not stated 


Threshold: visible 
line; as per manu- 
facturer 


Not stated; pre- 
sume lab staff 


Threshold: mean 
value of the fluo- 
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Fenollar 2020(a) 


Fenollar 2020(b) 


FIND 2020a 


FIND 2020b 


FIND 2020c (BR) 


PANBIO COVID-19 Ag 
(Abbott) (no product 
code reported) 


PANBIO COVID-19 Ag 
(Abbott) (no product 
code reported) 


NowCheck COVID-19 
Ag test (RG1901DG) 
(Bionote Inc) 


Panbio COVID-19 Ag 
Rapid Test (41FK10) 

(Abbott) (no product 
code reported) 


STANDARD Q COV- 
ID-19 Ag (O9COV30D) 
(SD Biosensor Inc) 


CGIA (from IFU) 


NP 


CGIA (from IFU) 


NP 


LFA (nos) 


SARS-CoV-2 nu- 
cleocapsid anti- 
gen 


CGIA (from IFU) 


Not reported 


CGIA (from IFU) 


Not reported 


Storage: not reported 


Samples tested: NP (direct) 
Timing of sampling: not stated 
Timing of test: tested within 1h 


Storage: none 


Samples tested: NP (direct) 
Timing of sampling: not stated 
Timing of test: tested within 1h 


Storage: none 


Samples tested: proprietary NP swab collect- 
ed by HCW (direct) 


Timing of sampling: median 4 days pso (IQR 
3, 6 days); 

day < 0-3 152, 39% 

day 4-7 180, 46% 

day = 8 58, 15% 


Timing of test: not specified; as soon as pos- 
sible after collection and within IFU recom- 
mendations 


Storage: room temperature for 1 h or 2-8 °C 
for 4h 


Samples tested: NP (direct) 


Timing of sampling: time pso recorded for 
115/124, 92% 

Day 0-3 89, 78% 

Day 4-7 23, 20% 

Day 8+ 3, 3% 


Timing of test: not specified; as soon as pos- 
sible after collection and within IFU recom- 
mendations 


Storage: author contact advises tested as 
soon as possible and within the time limit 
specified in the IFU 


Samples tested: NP; collected by HCW (di- 
rect) 


Timing of sampling: median 5 days pso (IQR 
4, 6 days) (for 397 patients); 

day < 0-3 85, 21% 

day 4-7 273, 69% 

day = 8 39, 10% 


Timing of test: tested as soon as possible 
and within the time limit specified in the IFU 


rescence signal 
plus 5 SD 


Not stated; pre- 
sume on-site test- 


ing 
Threshold: visual 


line; as per manu- 
facturer 


Not stated; pre- 
sume on-site test- 


ing 
Threshold: visual 


line; as per manu- 
facturer 


HCW 


Threshold: pres- 
ence of visible 
control and test 
lines 


HCW 


Threshold: pres- 
ence of visible 
control and test 
lines 


HCW 


Threshold: pres- 
ence of visible 
control and test 
lines 
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Storage: none 


FIND 2020c (CH) STANDARD Q COV- CGIA (from IFU) Samples tested: NP (direct) HCW 
ID-19 Ag (O9COV30D) 
(SD Biosensor Inc) Not reported Timing of sampling: median not reported Threshold: pres- 
(range 0-15); ence of visible 
day < 0-3 - 122, 67%% control and test 
day 4-7 - 54, 29% lines 
Day 8+ - 7, 34% 
Timing of test: tested as soon as possible 
and within the time limit specified in the IFU 
Storage: none 
FIND 2020d (BR) = STANDARD F FIA Samples tested: NP; collected by HCW (Di- HCW 
COVID-19 Ag FIA rect) 
(F-NCOV-01G, Not reported Threshold: as per 
10COV30D) (SD Timing of sampling: median 4 days pso (IQR = STANDARD F Ana- 
Biosensor Inc) 3, 6 days) (for 421 patients); lyzer; cut-off index 
day <0-3 - 131, 31% > 1.0 (as per IFU) 
day 4-7 - 248, 59% 
day >=8 - 42, 10% 
Timing of test: tested as soon as possible 
and within the time limit specified in the IFU 
Storage: none 
FIND 2020d (DE) STANDARD F FIA Samples tested: [1] NP; [2] Combined NOP HCW 
COVID-19 Ag FIA swabs; collected by HCW (direct) 
(F-NCOV-01G, Not reported Threshold: as per 
10COV30D) (SD Timing of sampling: median 3 days pso (IQR = STANDARD F Ana- 
Biosensor Inc) 2,5 days) (for 505 patients); lyzer; cut-off index 
day < 0-3 - 257, 51% > 1.0 (as per IFU) 
day 4-7 - 202, 47% 
day = 8 - 46, 9% 
Timing of test: tested as soon as possible 
and within the time limit specified in the IFU 
Storage: none 
FIND 2020e (BR) BIOCREDIT COVID-19 —_CGIA (from IFU) Samples tested: NP; collected by HCW (di- HCW 
Ag (G61RHA20) (Rapi- rect) 
GEN Inc) Not reported Threshold: visual 
Timing of sampling: median 5 days pso (IQR = appearance of test 
4, 7 days) (for 470 patients); and control lines 
day < 0-3 - 95, 20% 
day 4-7 - 296, 63% 
day =8-79, 17% 
Timing of test: tested as soon as possible 
and within the time limit specified in the IFU 
Storage: none 
FIND 2020e (DE) BIOCREDIT COVID-19 = CGIA (from IFU) Samples tested: [1] NP; [2] NOP; collected by HCW 
Ag (G61RHA20) (Rapi- HCW (direct) 
GEN Inc) Not reported Threshold: visual 


Timing of sampling: median 3 days pso (IQR 
2, 4 days) (for 701 patients); 
day < 0-3 - 472, 67% 


appearance of test 
and control lines 
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Fourati 2020 [A 
Fourati 2020 [B 
Fourati 2020 [C 


Fourati 2020 [D 


Fourati 2020 [E] 


Gremmels 
2020(a) 


Gremmels 
2020(b) 





[A] SARS-CoV-2 COV- [A] CGIA (from 


ID-19 Respi-Strip IFU) 
[B] Standard Q COV- B] LFA (nos) 
ID-19 Ag C] CGIA (from 


[C] PanBio COVID-19 _IFU) 

Antigen Rapid Test D] CGIA (from 
[D] Biosynex COV- IFU) 

ID-19 Ag BSS E] CGIA (from 
[E] COVID-VIRO Anti- IFU) 

gen Rapid Test 

[F] NG Test SARS- 
CoV-2 Ag (assay ex- 
cluded) 

(no product codes re- 
ported) 

([A] Coris BioCon- 
cept, Gembloux, Bel- 
gium 

[B] SD BIOSENSOR, 
Inc., Korea 

[C] Abbott, Chicago, 
Illinois, USA 

[D] Biosynex, Stras- 
bourg, France 

[E] AAZ, Boulogne- 
Billancourt, France 
[F] NG Biotech, 
Guipry, France 





Not stated 








Panbio COVID-19 Ag 
Rapid Test (lot 41AD- 
FO11A) (Abbott (Lake NP 
Country, IL, U.S.A)) 


CGIA (from IFU) 


Panbio COVID-19 Ag 
Rapid Test (lot 41AD- 
FO11A) (Abbott (Lake NP 
Country, IL, U.S.A)) 


CGIA (from IFU) 


day 4-7 - 161, 23% 
day = 8 - 68, 10% 


Timing of test: tested as soon as possible 
and within the time limit specified in the IFU 


Storage: none 


Samples tested: NP; collection not reported 
(VTM) 


Timing of sampling: pso (reported for 289 
samples): 

0-3 days 97, 34% 

4-7 days 103, 36% 

8-11 days 63, 22% 

212 days 26, 9% 

No. samples reported at > 7 days varied per 
test, maximum was 289 


Timing of test: not stated 


Storage: Frozen at -80 °C until use 


Samples tested: NP; obtained after NOP 
swab for RT-PCR; implies collected by HCW 
(unclear) 


Timing of sampling: cohort [1] (data on dura- 
tion of symptoms reportedly missing for 201 
participants; total reported here is 1138 but 
denominator for %s is 1166) 

day 1-3 pso 387, 33.2% 

day 4-7 560, 48.0% 

day >7191, 16.4% 


Timing of test: within 2 h of collection 


Storage: none described 


Samples tested: NP; obtained after NOP 
swab for RT-PCR; implies collected by HCW 
(direct) 


Timing of sampling: not stated; on presenta- 
tion 


Timing of test: within 2 h 


Laboratory staff 


Threshold: visual, 
as per manufac- 
turer 


2 independent ob- 
servers 


Threshold: visual 
line within 15 min; 
as per manufac- 
turer 


2 independent ob- 
servers 


Threshold: visual 
line within 15 min; 
as per manufac- 
turer 
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Gupta 2020 


Kruger 2020(a) 
Kruger 2020(b) 


Kruger 2020(c) 


Lambert-Niclot 
2020 


Standard Q rapid 
antigen detection 
test (SD Biosensor, 
Inc., Gurugram) (no 
product code report- 
ed) 


CGIA (from IFU) 


Not stated 


[A] Bioeasy 2019- 
nCoV Ag Fluores- 
cence Rapid Test Kit 
(Time-Resolved Fluo- 
rescence) 

[B] COVID-19 Ag 
Respi-Strip 

[C] STANDARD Q 
COVID-19 Ag Test 


[A] FIA 
[B] and [C] CGIA 


Not stated 


([A] Shenzhen 
Bioeasy Biotechnol- 
ogy Co. Ltd., Guang- 
dong Province, China 
[B] Coris Bioconcept, 
Gembloux, Belgium 
[C] SD Biosensor, Inc. 
Gyeonggi-do, Korea) 


(no product codes re- 
ported) 


COVID-19AgRespi-  CGIA 
Strip CORIS (no prod- 
uct code) (BioCon- 
cept®, Gembloux, 


Belgium) 


SARS-CoV-2 NP 


Storage: appears to be room temperature 


Samples tested: NP; collection method de- 
tailed but personnel not described; presume 
HCW. Sequence for specimen collection was 
random for both the samples (Ag and RT-PCR) 
(direct) 


Timing of sampling: symptomatic: 192 (95%) 
<5 days pso (incl 57 cases) 


Timing of test: immediate testing 


Storage: none 


Samples tested: drive-in centre: NP or OP 
Other centres: combined NOP (OP conducted 
first) 

RT-PCR swab obtained first, then same tech- 
nique repeated for Ag test (direct) 


Timing of sampling: overall: mean 5 days 

pso (SD 9.6). [A] 7.0 (SD 12.2); [B] 6.2 (SD 14.0); 
[C] 3.7 (SD 5.6) 

Timing of test: not stated but no delay re- 
ported (on-site testing) for drive-in and ambu- 
latory testing; secondary care samples trans- 
ported to lab 


Storage: as above 
RT-PCR swab obtained first, then same tech- 
nique repeated for Ag test 


Samples tested: NP swabs in VTM (collection 
process not described) (VTM) 


Timing of sampling: not stated 


Timing of test: not stated (soon after collec- 
tion) 


Storage: none; no cooling or freezing step 
used 


Same person who 
obtained swab; 
HCW 


Threshold: visual; 
test and control 
lines 


Drive-in and am- 
bulatory clinic: 
POC evaluation 
Secondary care: 
laboratory staff 


Threshold: [A] as 
per Analyzer; 

[B] and [C] visual 
appearance were 
interpreted by 2 
operators, each 
blinded to the re- 
sult of the oth- 

er. In case of dis- 
crepant results, 
both operators 
re-read the result 
and agreed ona fi- 
nal result. 

Invalid results 
were repeated 
once using the re- 
maining buffer ac- 
cording to the re- 
spective IFUs. 
Readouts were 
done within the 
recommended 
time for each Ag- 
RDT (10 minutes 
for Bioeasy, 15 
minutes for Coris 
and 15-30 minutes 
for SD Biosensor). 


Not stated; pre- 
sume lab staff 


Threshold: as per 
manufacturer 
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Linares 2020 


Liotti 2020 


Mak 2020 


Mertens 2020 


Nagura-Ikeda 
2020 


Nash 2020 


PanBio COVID-19 Ag 


Rapid Test Device (no 


product code) (Ab- 
bott Rapid Diagnos- 


tic Jena GmbH, Jena, 


Germany) 


STANDARD F COV- 
ID-19 Ag FIA (no 
product codes re- 
ported) (SD Biosen- 
sor (Suwon, South 
Korea)) 


BIOCREDIT COVID-19 
Ag (no product code 
reported) (RapiGEN 
Inc) 


COVID-19 Ag Respi- 
Strip (Coris BioCon- 
cept (Belgium)) (no 
product code report- 
ed) 


ESPLINE® SARS- 
CoV-2 (no product 
code reported) 

[Five other tests per- 
formed including RT- 
PCR and RT-LAMP, 
but not eligible for 
this review] (Fuji Re- 
bio Inc) 


Direct antigen rapid 
test (DARTTM); NP- 
based (E25Bio Inc 
(Cambridge MA)) 


CGIA (from IFU) 


Nucleocapsid 


FIA 


CGIA 


Not stated 


CGIA 


SARS-CoV and 
SARS-CoV-2 high- 
ly conserved nu- 
cleoprotein 


LFA (no reader 
device required) 


NP 


Immunochro- 
matographic pa- 
per-based (CGIA) 


NP 


Samples tested: NP; HCW obtained (direct) 
Timing of sampling: ED: 2 days pso (IQR? 1-5) 
PC: 4 days pso (IQR? 2-8) 

Table 3 reports range of 0-27 days pso or post 


COVID-19 contact, and range of 0-16 days for 
days pso for symptomatic cases only 


Timing of test: not stated; presume immedi- 
ate on-site testing 


Storage: not stated 


Samples tested: NP; collection not reported 
(not specified) 


Timing of sampling: not reported 
Timing of test: within 24 h after collection 


Storage: samples kept at 4 °C until testing 


Samples tested: throat saliva (TS, n= 45), 
nasopharyngeal swab and throat swab (NPS 
& TS, n= 103), nasopharyngeal aspirate and 
throat swab (NPA & TS, n= 81), sputum (n= 
45); no details of collection methods (VTM or 
PBS) 


Timing of sampling: not stated 
Timing of test: not stated; frozen samples 


Storage: stored at -70 °C until used for study 
purposes 


Samples tested: mixed (322 NP swabs, 4 NPA 
and 2 BAL) (VTM) 


Timing of sampling: not stated 

Timing of test: not described 

Storage: not reported 

Samples tested: saliva (self collected) (di- 
rect) 


Timing of sampling: saliva collected on ad- 
mission to hospital; IPD reports this was me- 
dian 7 days pso (1-14) 


Timing of test: not stated; frozen samples 


Storage: stored at -80 °C until sample prepa- 
ration 


Samples tested: nasal; collection not de- 
scribed (not specified) 


Timing of sampling: not stated 


Timing of test: not stated 


Not stated 


Threshold: not 
stated; as per 
manufacturer 


Not stated; lab 
staff 


Threshold: as per 
manufacturer 


Not stated; labo- 
ratory staff pre- 
sumed 


Threshold: not 
stated 


Laboratory techni- 
cian 


Threshold: visi- 
ble reddish-purple 
band appearing at 
the Test line posi- 
tion (T) 


Not stated; im- 
plies laboratory 
staff 


Threshold: not 

stated; appear- 
ance of test line 
implied 


Not stated; pre- 
sume lab staff 


Threshold: visual 
line 
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PHE 2020(a) 


PHE 2020(b) 


PHE 2020(c) 
[non-HCW test- 
ed] 


PHE 2020(d) 
[HCW tested] 


PHE 2020(d) [Lab 
tested] 


PHE 2020(e) 


Porte 2020a 


Porte 2020b [A] 


Porte 2020b [B] 


Innova SARS-CoV-2 
Antigen Rapid Qual- 
itative Test (Innova 
Medical Group) (no 
product code report- 
ed) 


Innova SARS-CoV-2 
Antigen Rapid Qual- 
itative Test (Innova 
Medical Group) (no 
product code report- 
ed) 


Innova SARS-CoV-2 
Antigen Rapid Qual- 
itative Test (Innova 
Medical Group) (no 
product code report- 
ed) 


Innova SARS-CoV-2 
Antigen Rapid Qual- 
itative Test (Innova 
Medical Group) (no 
product code report- 
ed) 


Innova SARS-CoV-2 
Antigen Rapid Qual- 
itative Test (Innova 
Medical Group) (no 
product code report- 
ed) 


Diagnostic Kit for 
2019-Novel Coron- 
avirus (2019-nCoV) 
Ag Test (Cat. N° 
YRLF04401025, lot N 
° 2002N408) (Bioeasy 
Biotechnology Co., 
Shenzhen, China ) 


[A] SOFIA SARS Anti- 
gen FIA 


CGIA (from IFU) 


Not stated 


CGIA (from IFU) 


Not stated 


CGIA (from IFU) 


Not stated 


CGIA (from IFU) 


Not stated 


CGIA (from IFU) 


Not stated 


CGIA 


SARS-CoV-2 nu- 
cleocapsid pro- 
tein 


Both FIA 


NP 


Storage: banked frozen prior to testing 


Samples tested: combined NP and OP 
swabs; inpatients so presumed HCW collected 
(VTM) 


Timing of sampling: not stated 
Timing of test: not stated 


Storage: frozen (PCR+); fresh (PCR-) 


Samples tested: OP swabs; self-collected 
(VTM) 


Timing of sampling: 1 week after outbreak; 
no further details 


Timing of test: not stated 


Storage: transported at 4 °C to Porton Down 
for testing 


Samples tested: anterior nasal and com- 
bined OP samples. Self-collected (direct) 


Timing of sampling: not stated 
Timing of test: immediate testing 


Storage: none 


Samples tested: combined anterior nasal 
and OP swabs; self-collected (direct) 


Timing of sampling: not stated 
Timing of test: immediate testing 


Storage: none 


Samples tested: OP swab for PHE staff; NP 
swab for hospital staff. All self-collected (di- 
rect) 


Timing of sampling: not stated 
Timing of test: immediate testing 


Storage: none 


Samples tested: mixed (322 NP swabs, 4 NPA 
and 2 BAL) (VTM) 


Timing of sampling: not stated 
Timing of test: not described 
Storage: not reported 


Samples tested: naso-oropharyngeal flocked 
swabs; obtained by trained personnel (VTM) 


Laboratory staff 


Threshold: visual 
line; as per manu- 
facturer 


Laboratory staff 


Threshold: visual 
line; as per manu- 
facturer 


Self-trained non- 
HCW 


Threshold: visual 
line; as per manu- 
facturer 


[A] HCW on-site 
[B] laboratory sci- 
entist at PHE 


Threshold: visual 
line; as per manu- 
facturer 


Lab scientist 


Threshold: visual 
line; as per manu- 
facturer 


Laboratory techni- 
cian 


Threshold: as per 
manufacturer 


Laboratory staff 
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(Continued) 


Schildgen 2020 
[A] 


Schildgen 2020 
[B] 


Schildgen 2020 
[C] 


Scohy 2020 


Shrestha 2020 


Takeda 2020 


[B] STANDARD® F 
COVID-19 Ag FIA 

(no product codes re- 
ported) 


([A] Quidel Corpora- 
tion, San Diego, CA, 
USA 

[B] SD Biosensor Inc., 
Gyeonggi-do, Repub- 
lic of Korea) 


[A] BIOCREDIT 

[B] Panbio 

[C] SARS-CoV-2 Rapid 
Antigen test ([A] 
RapiGEN, [B] Abbott, 
[C] Roche) (no prod- 
uct code reported) 


COVID-19 Ag Respi- 
Strip (product code 
not reported) (Coris 
Bioconcept) 


BIOCREDIT (RapiGen) 
(no product code re- 
ported) 


ESPLINE SARS-CoV-2 
(no product code re- 
ported) (Fujirebio 
Inc) 


All CGIA 


Not stated 


CGIA 


NP 


Not stated 


Not stated 


LFA using alka- 
line phosphatase 
(ALP)-labelled 
antibodies 


SARS-CoV-2 anti- 
gen (from IFU) 


Timing of sampling: all <5 days pso; median 
PCR+: 2 days (IQR 1-3) 

PCR-: 1 day (IQR 0.75-4) 

Timing of test: not stated; frozen samples 


Storage: stored at -80 °C following RT-PCR 


Samples tested: BAL (n = 13); throat wash (n 
= 50, including 27 from asymptomatic) (not 
specified) 


Timing of sampling: not stated 
Timing of test: not stated 


Storage: not stated 


Samples tested: NP (not specified) 
Timing of sampling: not reported 


Timing of test: not stated; immediate or after 
period of storage 


Storage: none or stored at 4 °C until the test 


Samples tested: NP (Direct) 
Timing of sampling: day 5 of quarantine 
Timing of test: not stated 


Storage: none reported; other sample from 
the same individual was processed for the re- 
sults as instructed by the manufacturing com- 
pany of antigen kit 


Samples tested: NP; collection not reported 
(not specified) 


Timing of sampling: not stated but all cas- 
es presumed by study authors to be from pa- 
tients suspected of SARS-CoV-2 for the first 
time 


Timing of test: not stated 


Storage: swabs mixed with sample treatment 
solution; no storage reported 


Threshold: as per 
manufacturer; 
both using analyz- 
er device 


Not stated; pre- 
sume lab staff 


Threshold: as per 
manufacturer 


Not stated 


Threshold: visu- 

al appearance of 
T line; also states 
that "Two versions 
of the test were 
evaluated. On the 
second version, 
conjugate was 
coupled on a dif- 
ferent way and the 
control line was 
optimized." 


Lab technician 
(trained) 


Threshold: visual 
line; as per manu- 
facturer 


Not stated; labo- 
ratory staff pre- 
sumed 


Threshold: visual 
line, as per manu- 
facturer 





Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 
Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 


Collaboration. 


371 


+‘ Cochrane 
tw Library 


Trusted evidence. 
Informed decisions. 
Better health. 


Cochrane Database of Systematic Reviews 





(Continued) 


Van der Moeren 
2020(a) 


Van der Moeren 
2020(b) 


Veyrenche 2020 


Weitzel 2020 [A] 
Weitzel 2020 [B] 
Weitzel 2020 [C] 


Weitzel 2020 [D] 


BD Veritor System for 
Rapid Detection of 
SARS-CoV-2 (Becton NP 
Dickinson) (no prod- 

uct code reported) 


CGIA (from IFU) 


BD Veritor System for 
Rapid Detection of 
SARS-CoV-2 (Becton NP 
Dickinson) (no prod- 

uct code reported) 


CGIA (from IFU) 


Coris COVID-19 Ag 
Respi-Strip (BioCon- 
cept®, Gembloux, NP 
Belgium) (no product 

code reported) 


CGIA 


[A] Biocredit COV- 
ID-19 Ag One Step 
SARS-CoV-2 Antigen 
Test (RapiGEN Inc., 
Anyang-si, Gyeong- 
gi-do, Republic of Ko- 
rea) 

[B] COVID-19 Antigen 
Rapid Test Device 
StrongStep® COV- 
ID-19 Antigen Test 
(Liming Bio-Products 
Co., Jiangsu, China) 
[C] Huaketai New 
Coronavirus (SARS- 
CoV-2) N Protein De- 


CGIA 


Not reported in 
study 


Samples tested: NOP? "specimen from the 
throat and the superficial nasal cavities (bilat- 
eral, 2.5 cm proximal from the nostril)"; col- 
lected by GGD employee (direct) 


Timing of sampling: time pso only provided 
for PCR+ cases: 12 < 7d; 12=7d;4=n0 pso da- 
ta 


Timing of test: within 6 h (at lab) 


Storage: stored dry in sterile test tubes and 
stored and transported on dry ice until pro- 
cessing at the laboratory; tested within 6 h af- 
ter collection 


Samples tested: NOP? "specimen from the 
throat and the superficial nasal cavities (bilat- 
eral, 2.5 cm proximal from the nostril)"; col- 
lected by GGD employee (direct) 


Timing of sampling: not reported; on presen- 
tation 


Timing of test: within 6 h (at lab) 


Storage: stored dry in sterile test tubes and 
stored and transported on dry ice until pro- 
cessing at the laboratory; tested within 6 h af- 
ter collection 


Samples tested: NP; collection not described 
(VTM) 


Timing of sampling: day 1-20 pso, median 

Ct < 25 - 7 (4, 10; presume this is IQR but could 
be range - is described as SD in paper) 

Ct 25-35 - 8 (4, 12) 

Ct>35-11(7, 15) 


Timing of test: not stated 


Storage: not stated; RT-PCR conducted 
prospectively within a few hours but not re- 
ported for Ag testing 


Samples tested: mixed (322 NP swabs, 4 NPA 
and 2 BAL) (VTM) 


Timing of sampling: not stated 
Timing of test: not described 


Storage: not reported 


Trained laboratory 
technicians 


Threshold: [A] us- 
ing Analyzer 

[B] visual inspec- 
tion 


Trained laboratory 
technicians 


Threshold: [A] us- 
ing Analyzer 

[B] visual inspec- 
tion 


Not stated; pre- 
sume lab staff 


Threshold: visual, 
as per manufac- 
turer 


Single trained lab- 
oratory technician 
under BSL2 cabi- 
net; visual outputs 
read by 2 indepen- 
dent observers 
with referral to 3rd 
if needed 


Threshold: as per 
manufacturer; Sa- 
vant test required 
use of manufac- 
turer supplied 

UV torch due to 
unavailability of 
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(Continued) 


Young 2020 


tection Kit (Fluores- 
cence immunochro- 
matography) (Savant 
Biotechnology Co., 
Beijing, China), 

[D] Diagnostic Kit for 
2019-Novel Coron- 
avirus (2019-nCoV) 
Ag Test (Fluores- 
cence Immunochro- 
matographic Assay) 
(Bioeasy Biotechnol- 
ogy Co., Shenzhen, 
China) 


BD Veritor SARS- 
CoV-2 antigen test 
(no product codes) 
(Becton, Dickinson 
and Company, BD 
Life Sciences—Inte- 
grated Diagnostic 
Solutions, San Diego, 
CA) 


LFA (nos) 


NP 


Samples tested: nasal; clinician collected 
from both nostrils (same swab) (Direct) 


Timing of sampling: all < 7 days pso; median 
3.0 d, mean 3.2d 

38 (15%) 1 day pso, 57 (23%) 2 days, 54 (22%) 
3 days, 40 (16%) 4 days, 37 (15%) 5 days 

19 (8%) 6 days, 6 (2%) 7 days 


Timing of test: not stated; frozen samples 


Storage: swabs were shipped for testing on 
dry ice (-70 °C); 


reader device in 
Chile 


Not stated; Veritor 
testing was per- 
formed internally 
at BD (San Diego, 
CA, USA) 


Threshold: as per 
manufacturer 


Ag: antigen; BAL: bronchoalveolar lavage; CGIA: colloidal-gold immunoassay; Ct: cycle threshold; FIA: fluorescent immunoassay; 
HCW: healthcare worker; IFU: [manufacturers'] instructions for use; IPD: individual patient data; IQR: interquartile range; LFA: later- 
al flow assay; NOP: naso-oropharyngeal; NP: nasopharyngeal; NPA: nasopharyngeal aspirate; OP: oropharyngeal; pso: post-symp- 
tom onset; PBS: phosphate-buffered saline; PCR+: polymerase chain reaction-positive; PCR-: polymerase chain reaction-negative; 
PHE: Public Health England; POC: point-of-care; RT-PCR: reverse transcription polymerase chain reaction; SD: standard deviation; 


TS: throat swab; UV: ultraviolet; VTM: viral transport medium 


Appendix 11. Molecular tests: summary study details 


Study 


Assennato 
2020 


Preprint 


172 (88; 91 af- 
ter retesting 
with RT-PCR) 


Study design; inclu- 
sion criteria 


Single group; 


symptomatic individu- 
als with suspected COV- 
ID-19 sent for routine 
laboratory diagnosis; 
supplied via PHE 


Recruitment: not stated 


Setting; 
country (re- 
cruitment 
dates) 


Laborato- 
ry-based (no 
further de- 
tails); UK 


(Not stated) 


Participant Reference standard 
characteris- 
tics Samples and timing 
‘sympto- RT-PCR (single assay); 
matic';nofur- Threshold < 36 Ct 
ther details 

Target: (1) RdRp, E gene 
Not stated (2) RdRp ‘different region’ 


As for index; combined 
nose and throat swab in 
VIM 


Timing: not stated 


Interval: not stated; seems 
likely reference was car- 


Missing data or unin- 
terpretable results 


None reported 


Index: 3 FP and 1 FN 
result retested using 
SAMBA-II; same results 
obtained on repeat 


Reference: 3 FP and 1 
FN result were re-test- 
ed* 

- all 3 FPs found to be 
borderline +ve for = 

1 target gene on ei- 
ther Colindale or Cam- 
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(Continued) 


Broder 2020 


Accepted 
manuscript 


35 (35) 


Chen 2020a 
Published 


58 (58); can 
only include 
data for 55 
+ve on NP 
swabs 


Collier 2020 


Preprint and 
published ver- 
sion (25-8-20) 


149 (32) 


Single group (cases); 


Samples +ve on RT-PCR 
(Roche Cobas 6800) 
with lower range of viral 
load (E target Ct = 30) 


Recruitment: not stat- 
ed; deliberate sampling 
according to viral load 


Single group (cases); 


archived paired sam- 
ples from COVID-19 in- 
patients 


Recruitment: not stated 


Single group; 


patients admitted with 
a possible diagnosis of 
COVID-19 


Recruitment: consecu- 
tive 


Laborato- 
ry-based (not 
stated); USA 


(Not stated) 


Hospital in- 
patient (no 
further detail); 
People’s Re- 
public of Chi- 
na 


(Not stated) 


Hospital inpa- 
tient (no fur- 
ther detail); 
UK 


(6 April-2 May 
2020) 


Not stated; 
lower viral 
load 


Not stated 


Not stated 


Median age 38 
years; 28, 48% 
male 


Not stated 


Mean age 62.7 
years, 70, 47% 
male 


ried out for routine diag- 
nostic testing 


RT-PCR (single assay) 


Target: E gene (unclear if 
other genetic targets as 
well) 


N/A 
As for index test; NP swab 


Timing: not stated; pre- 
sume on presentation 


Interval: same samples; in- 
dex within 3 days of refer- 
ence 


RT-PCR (single assay) 
Target: RdRp 


N/A only cases included 
Not stated; infer single -ve 


Same as index test 


Timing: not stated; prior to 
index test 


Interval: simultaneous; 
same samples 


RT-PCR (single assay) 
Target: not stated 


Not stated; separate swab 
used as participants were 
excluded if > 18-h interval 
between swab collections 


Timing: not stated 


Interval: <18h 


bridge (Wuhan) test 
(reclassified as TP) 
- the FN result re- 
mained +ve on both 
RT-PCR assays 


None reported 
Index: none reported 


Reference: samples 
+ve on reference were 
tested by in-house as- 
say using modified 
CDC protocol 


None reported, how- 
ever 3 samples +ve on- 
ly on saliva excluded 
by review team 


Not stated 
Index: not stated 


Reference: none re- 
ported 


Yes; 5 discarded VIM, 
1 timing of PHE swab 
not reported, 1 inade- 
quate SAMBA swab, 2 
swab interval >24h 


Index: not described 
"Indeterminate ... 
tests were repeated ... 
until a valid result was 
obtained." 

Discrepant results 
re-tested on original 
samples 


Reference: "indetermi- 
nate ... tests were re- 
peated on a replicate 
... swab until a valid 
result was obtained." 
Discrepant results 
re-tested on original 
samples 
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(Continued) 
Cradic 2020(a) Single group; Mixed (ED or All sympto- Composite; result ob- None reported 
inpatients); matic, no fur- tained from at least 2 of 
published symptomatic patients USA ther details. 3 commercial assays (in- Index: none reported 
meeting criteria for cludes 2 RT-PCRs and Ab- 
184 (33) testing (Not stated ) Not stated bot ID NOW) Reference: none re- 
ported 
Recruitment: not stated Target: RdRp, S or OR- 
Flab gene (either present), 
ORF1ab or E gene (both 
present for +ve, either 
present for presumptive 
+ve) 
Same as index test 
Timing: not stated 
Interval: simultaneous - 
same swab 
Cradic 2020(b) Single group; Hospital A&E All sympto- RT-PCR (single assay) None reported 
(ED); USA matic, no fur- 
published presenting to ED with ther details. Target: S or ORFlab gene Index: none reported 
signs/symptoms of (Not stated ) (either present) 
182 (13) COVID-19 submitted for Not stated Reference: none re- 
routine laboratory test- NP swab in UTM, same as ported 
ing (n = 182) index 
Recruitment: not stated Timing: not stated 
Interval: simultaneous; 
paired swabs 
Dust 2020 Two-group; Laborato- Not reported RT-PCR (single assay); None reported 
ry-based (un- Ct threshold not stated 
Published [1] SARS-CoV-2 +ve clear; submit- Index: none reported 
samples submitted for ted to labora- Target: E, N1 
38 (20) routine viral diagnostic tory): Canada Reference: none re- 
testing NP (as for index) ported 
[2] samples +ve for oth- —_ (Not stated) qiiiesnaiseted 
er respiratory infection pe Mente 
Convenience sampling Interval: simultaneous 
(same swab) 
Recruitment: retrospec- 
tive 
Ghofrani 2020 ‘Single group Mixed (hospi- ‘Majority’ RT-PCR (no details) None reported 
tal and com- symptomatic, 
Published Patients with both RT- munity); USA nofurtherde- Target: not stated Index: none reported 
PCR and POC test re- tails 
113 (17) sults available (n=113), (6 April-21 Mixed; either pairedswabs Reference: none re- 
including: April 2020) Not stated (within 3 days ofeach oth- _ ported 
[1] symptomatic pa- er) or same samples used 
tients with a PCR swab Fidtiverintscateel 
test close to presenta- Pate netstane 
tion and a re-swab for Interval: some same sam- 
POC testing . ple; paired samples could 
[2] patients with +ve RT- be up to 3 days apart 
PCR results and rem- 
nant NP swabs avail- 
able for POC test, 
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(Continued) 
[3] asymptomatic pa- 
tients with +ve POC re- 
sult on admission who 
were re-swabbed for 
RT-PCR confirmation. 
N per group was not re- 
ported 


Recruitment: conve- 

nience 
Gibani 2020 Three sources of partic- 
ipants: 
[1] self-referred, HCWs 
or their family members 
with suspected COV- 
ID-19 who were not ad- 
mitted to hospital (n = 
280) 
[2] ED patients with sus- 
pected COVID-19 (n= 
15) 
[3] hospital inpatient 
admissions with or 
without suspected COV- 
ID-19 (n = 91) 
Total N 418 paired sam- 
ples; 32 excluded as in- 
valid (patient group not 
reported), 24 invalid on 
DnaNudge and 8 on RT- 
PCR) 


Published 


418 () 


[1] and [2] not reported 
[3] consecutive 


Recruitment: prospec- 
tive 


Goldenberger 
2020 


Two-group; 


[1] SARS-CoV-2 +ve 
samples selected to re- 
flect a broad range of Ct 
values 

[2] SARS-CoV-2 -ve sam- 
ples (n= 9) 


Published 


19 (10) 


Sampled from patients 
suspected of COVID-19 
undergoing routine di- 
agnostics within a 1- 
week period 


Convenience 


Recruitment: unclear 


Harrington 
2020 


Single group; 


Mixed (com- 
munity, A&E, 
inpatient); 
London or Ox- 
ford, UK 


Only group [3] 
were inpatient 


median age 46 
years (IQR 31- 
66); 124, 32% 
({1] 10 April-12 = male 
May 

[2] 2-24 April 

[3] 12-18 May) 


Laborato- 
ry-based 
(unclear); 
Switzerland 


Not reported 


(1 week dur- 
ing 2020 pan- 
demic) 


Hospital A&E Not stated 
(EDs (n = 3) or 


urgent care 


RT-PCR (multiple assays) 
Target: see above 

NOP (paired) 

Timing: not stated 


Interval: simultaneous 
(paired) 


RT-PCR (single assay); 
Threshold NR but all PCR+ 
<33 Ct 


Target: E, ORF1 
NP (same as index) 
Timing: not stated 


Interval: simultaneous 
(same swab) 


RT-PCR (single assay) 


Target: not stated 


Additional 47 samples 
not 'paired'; not col- 
lected on same date 


32 samples exclud- 
ed; 24 invalid on 
DNANudge (failed to 
amplify RNaseP; 22/24 
with associated RT- 
PCR result were -ve) 
and 8 on RT-PCR (all 8 
from 1 site) 


Index: none reported 


Reference: none re- 
ported 


None reported 
Index: none reported 


Reference: none re- 
ported 


None reported 


Index: none reported 
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(Continued) 
Accepted 
manuscript 


524 (186) 


Hogan 2020 
Preprint 


100 (50) 


Hou 2020 


Accepted 
manuscript 


285 (153) 


Jin 2020 
Published 


52 (6) 


Jokela 2020 
Preprint 


107 (61); only 
90 tested with 
Xpert Xpress 


Symptomatic patients 
meeting diagnostic cri- 
teria for COVID-19 


Recruitment: consecu- 
tive 


Single group; 


adult patients from one 
hospital and paediatric 
and adult samples from 
surrounding hospitals 


Recruitment: unclear; 
equal numbers of +ve 
and -ve RT-PCR samples 


Single group; 


remnant OP swabs sub- 
mitted for SARS-CoV-2 
testing 


Recruitment: not stated 


Single group; 


paired dry swabs and 
NP or OP swabs in UTM 
(includes pre-admission 
screening for surgical 
patients) 


Recruitment: unclear 


Two-group: 


NP or OP swab samples 
sent to university labo- 
ratory: 

[1] for SARS-CoV-2 test- 
ing (n= 97), 


centres (n= 

2)); USA 

(Not reported) 

Laborato- Not stated 

ry-based (clin- 

ical virology 

laboratory); 

USA 

(7-13 April 

2020) 

Laborato- 178 (62.5%) 

ry-based inpatient; 107 

(mixed inpa- (37.5%) out- 

tient and out- _ patients. Site 

patient); Chi- 2 were all in- 

na patients 

(Febru- 220 (77.2%) 

ary-April2020) aged<65 
years; 159 
(55.8%) male 

Laborato- Not stated 

ry-based (un- 

clear); USA 

(23-26 April 

2020) 

Laborato- Not stated 


ry-based (not 
reported); Fin- 
land 


(March-May 
2020) 


Not specifically stated; 
presume yes as central lab 
used 


NP swabs (paired) 
Timing: VTM (no detail) 


Interval: simultaneous 
swab collection (different 
swabs for index and refer- 
ence) 


RT-PCR (single assay) 
Target: E gene 

As for index test; NP swab 
Timing: not stated 


Interval: not stated implies 
tests undertaken soon af- 
ter collection 


RT-PCR (multiple assays) 
Target: not stated 

OP (same as for rapid test) 
Timing: not stated 


Interval: simultaneous 
(same swab); time period 
of frozen storage was not 
reported 


RT-PCR (single assay) 
Target: ORF1/a, E gene 


Not stated for paired sam- 
ples, but for full cohort NP 
and OP swabs in VTM used 
(400 uL) 


Timing: not stated 


Interval: simultaneous 
(paired swabs) 


RT-PCR (multiple assays) 


Target: 1) N gene, 2) or- 
flab and E, 3) orflab and 
N 


NP or OP, as for index 


Reference: 2 initial FPs 
had repeat sampling: 
- 1 retested on RT-PCR 
only and was +ve (des- 
ignated as TP) 

- lretested on RT-PCR 
and ID Now and was - 
ve on both (designat- 
ed as TN) 


None reported 


3 invalid results were 
re-tested; 1+ve and 2 
-ve 


Index: 1 known RT- 
PCR+ sample with 
faint +ve test line re- 
tested (same result; 
considered +ve) 


Reference: none re- 
ported 


None reported 
Index: none reported 


Reference: none re- 
ported 


None reported 
Index: none reported 


Reference: none re- 
ported 


107 samples tested 
with Novodiag but on- 
ly 90 for Xpert 


None reported 


Index: none reported 
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(Continued) 


Lephart 2020 
[A] 


Preprint 


[1] 75 (16) 


Lieberman 
2020 


Accepted 
manuscript 


169 (87) 


Loeffelholz 
2020 


Accepted 
manuscript 


486 (220) 


[2] pre-pandemic sam- 
ples sent for testing due 
to suspicion of other 
respiratory virus infec- 
tion (n = 10) 


Recruitment: not stated 


Single group; 


- patients presenting to 
ED (75) 


Recruitment: not stated 


Second cohort of 13 
cases excluded 


Single group; 


Samples submitted for 
clinical diagnostic test- 


ing 


Recruitment: not stated 


Two-group; 


patients referred for 
COVID-19 testing at ac- 
cording to the local cri- 
teria 


Recruitment: conve- 
nience; deliberate sam- 
pling to enrich for +ve 
specimens 


Hospital A&E Not reported 

([1] ED; [2] in- 

patient); USA 

(22 April-5 

May 2020) 

Laborato- Not stated 

ry-based (not 

reported); 

USA 

(Not stated) 

Laborato- Not stated 

ry-based (not 

stated); USA, Adults at all 

UK, France, sites except 

Italy New York City 
Dept. Health 

(1 March-2 and Mental 

April 2020) Hygiene and 
Niguarda Hos- 
pital where 


all age groups 
were tested 
(ages not stat- 
ed) 


Interval: simultaneous 
(same samples) 


Composite: result from = 
2 of 4 commercial assays 
(includes ID NOW and 3 
RT-PCR assays (incl Xpert 
Xpress)) 


Target: not stated 


Three -ves (on different as- 
says) required for absence 
of infection (same as for 
Xpert Xpress) 


Timing: within 24 h of 
sample collection (on pre- 


sentation at ED); no fur- 
ther detail 


Interval: same swab [B], or 
paired collection [A] 


RT-PCR (single assay); 
Threshold not stated 


Target: NI, N2 
As for index test; NP swab 
Timing: not stated 


Interval: all testing con- 
ducted within 72 h 


RT-PCR (multiple assays) 


Target: different targets 
depending on RT-PCR test 
used (see cut-off index) 


Same as for index test 
Timing: as for index test 


Interval: same samples 
but majority of index tests 
performed after frozen 
storage for undefined peri- 
od 


Reference: none re- 
ported 


None reported 


Index: [A] no invalid 
results 

[B] 1 'invalid' result; 
not reported if this 
was a 'presumptive 
+ve' (E gene only) on 
Xpert Xpress or no re- 
sult 


Reference: none re- 
ported 


None reported; review 
team excluded data 
for 28 specimens com- 
paring Panther Fusion 
with DiaSorin Sim- 
plexa 


Not stated 
Index: not stated 


Reference: inconclu- 
sive' (ie one genetic 
target detected) con- 
sidered +ve 


4 Xpert Xpress test re- 
sults lost permanent- 
ly (single instrument 
computer malfunc- 
tion); + 1 invalid ex- 
cluded 


1 Xpert Xpress test in- 
valid due to cartridge 
error 


Index: presumptive 
+ve results not re- 
analysed by Xpert 
Xpress; all discrepant 
results reanalysed by 
a 3rd RT-PCR method 
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(Continued) 


Mitchell 2020 


Accepted 
manuscript 


61 (46) 


Moore 2020 
Preprint 


200 (125) 


Moran 2020 


Accepted 
manuscript 


103 (42) 


Rhoads 2020 


Accpeted 
manuscript 


96 (96) 


Single group; 


Samples +ve and -ve on 
one of two SARS-CoV-2 
RT-PCR assays 


Recruitment: not stat- 
ed; possible deliberate 
sampling of +ve cases 


Two-group; 


symptomatic (fever or 
cough or shortness of 
breath) adult and pe- 
diatric outpatients, ED 
patients, and inpatients 


Recruitment: consec- 
utive (first 94 partici- 
pants), then deliberate 
sampling used 


Single group; 


inpatients and ambula- 
tory patients 


Recruitment: not stated 


Single group (cases); 


Samples +ve using stan- 
dard of care testing 


Recruitment: conve- 
nience 


Laborato- 
ry-based (2 
independent 
laboratories); 
USA 


(Not stated) 


Mixed (outpa- 
tients, ED pa- 
tients and in- 
patients); USA 


(27 March-9 
April 2020) 


Laborato- 
ry-based (in- 
patient and 
ambulatory; 
samples se- 
lected from 
central labo- 
ratory); USA 


(Not stated) 


Laborato- 
ry-based (in- 
cludes self- 
collected and 
provided-col- 
lected sam- 
ples); USA 


(Not stated) 


Not stated 


79 (39.5%) 
hospitalised 
including 29 in 
ICU, 76 (38%) 
ambulatory 
care includ- 
ing 55 seen 

in a designat- 
ed COVID-19 
screening clin- 
ic), and 45 
(23%) seen at 
ED. 


Mean age 50 
years (SD 17 
years), 92 
(46%) men 


Not stated 


Not stated 


RT-PCR (one of two assays) 
Target: not stated 

As for index test 

Timing: as for index test 


Interval: same samples 
but used at different times 
(samples used for index 
test stored at -80 C) 


RT-PCR (multiple assays); 
Threshold < 40 Ct or pres- 
ence of amplification 
curve 


Target: a. N1, N2 
b. N, RdRp 


As for index test; NP swab 
Timing: not stated 


Interval: all 3 tests con- 
ducted within 72 h of sam- 
ple collection 


RT-PCR (single assay) 
Target: ORF1,E 


As for index; nasal or NP 
swabs 


Timing: not stated 


Interval: not stated; same 
sample 


RT-PCR (multiple assays) 
Target: N1 and N2 

As for index test 

Timing: as for index test 


Interval: same samples 
used 


Reference: incon- 
clusive results ana- 
lyzed by a 3rd RT-PCR 
method 


None reported 
Index: none reported 


Reference: none re- 
ported 


2 invalid excluded 


2 results were invalid 
on ID Now and were 
not retested (exclud- 
ed) 


Index: none reported 


Reference: discordant 
results on RT-PCR had 
record review to de- 
termine presence/ab- 
sence COVID-19 infec- 
tion 


None reported 


Index: single FP (-ve 
on E gene and low 
+ve on N gene) retest- 
ed with Xpert Xpress 
and considered -ve on 
both targets 


Reference: single FP 
was retested on RT- 

PCR and found to be 
repeatedly -ve 


None reported 
Index: none reported 


Reference: RT-PCR de- 
tected only one of two 
targets for two sam- 
ples (both considered 
+ve (diagnosed as +tve 
on original sample 
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(Continued) 


Smithgall 
2020 [A] 


Published 


113 (88) 


SoRelle 2020 


Published let- 
ter 


83 (39) 


Stevens 2020 


Accepted 
manuscript 


104 (54) 


Szymczak 
2020 


Published 


79 (29 +ve on 
stool; 48 pre- 
viously +ve on 
NP/OP swab) 


Two-group 


Routine clinical testing 
by RT-PCR 


Recruitment: unclear; 
describes deliberate 
sampling of samples 
with high, medium and 
low Ct values on RT-PCR 


Unclear design; 


participants sympto- 
matic for COVID-19 


Sampling: not stated 


Recruitment: not stated 


Unclear design; 


Residual samples from 
symptomatic and 
asymptomatic individu- 
als undergoing routine 
testing; selected to rep- 
resent the full range of 
Ct values 


Sampling: convenience 


Recruitment: retrospec- 
tive 


Single group; 


remnant samples from 
patients with sympto- 
matic diarrhoea sub- 
mitted for routine diag- 
nostic testing 


Recruitment: conve- 
nience 


Laborato- 
ry-based (in- 
patient and 
ED); USA 


(8 April-13 
April) 


Laborato- 
ry-based (un- 
clear); USA 


(Not reported) 


Laborato- 
ry-based 
(serving adult 
and pediatric 
tertiary care 
hospitals); 
USA 


(31 March-7 
April) 


Laborato- 
ry-based (un- 
clear); USA 


(21 April-15 
May 2020) 


Not stated 


111 adult 
(range 23-101 
years; aver- 
age 65 years 
for RT-PCR+ 
and 43 years 
for RT-PCR-); 
2 paediatric 
(age 1 day and 
5 days) 

61, 54% male 


All sympto- 
matic 


Not reported 


Unclear; 
"symptomatic 
and asympto- 
matic’; 

Of 54 cases, 
10 (19%) were 
low viral low 
(Ct > 35) 


Not reported 


All sympto- 
matic for diar- 
rhoea 


Not stated 


RT-PCR (single assay) 
Threshold < 37 Ct on both 
target genes 


Target: ORF1 a/b, E-gene 
Not stated 

As for index test 

Timing: as for index test 


Interval: simultaneous; 
same samples used 


RT-PCR (multiple assays) 
Target: not stated 
NP in VTM (paired) 
Timing: not stated 


Interval: paired 


RT-PCR (single assay) 


Target: 2 regions of OR- 
Flab 


NP in VTM; as for index test 
Timing: not stated 


Interval: same sample 


RT-PCR (single assay) 
Target: two ORF1a regions 
Stool, as for index 


Timing: some samples 
frozen at -80 °C prior to 
testing with Hologic Pan- 
ther Fusion 


Interval: simultaneous; 
same swabs 


testing); both were -ve 
on index test) 


None reported 


Index: Xpert: 1 sample 
was a presumptive +ve 
based on detection of 
E-gene target but not 
the N2 target 


Reference: none re- 
ported 


None reported 
Index: none reported 


Reference: none re- 
ported; presumptive 
+ves not mentioned 


6 samples excluded 
due to insufficient 
sample volume 


1 RT-PCR+ sample re- 
tested on Xpert Xpress 
due to initial interpre- 
tation of no results (in- 
valid); Xpert +ve on re- 
test 


Index: no presumptive 
+ves were observed 


Reference: 1 RT-PCR 
+ sample that was - 
ve on both targets for 
Xpert Xpress (FN) was 
re-tested on Panther 
Fusion and found to 
be -ve (TN) 


None reported 


Index: discrepant re- 
sults re-tested with 
both index and refer- 
ence test 


Reference: as above 
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(Continued) 


Thwe 2020 
Published 


161 (14) 


Wolters 2020 


Accepted 
manuscript 


88 (58) 


Wong 2020 
Published 


162 (119) 


Zhen 2020 [A] 


Accepted 
manuscript 


108 (58) 


Single group; 


symptomatic patients 
with paired samples 


Sampling: not stated 


Recruitment: retrospec- 
tive 


Two-group; 


Samples selected from 
laboratories on the ba- 
sis of presence/absence 
of 2 genetic targets on 
RT-PCR 


Recruitment: not stat- 
ed; deliberate sam- 
pling according to tar- 
get gene 


Single group; 


samples submitted for 
routine testing from pa- 
tients with suspected 
COVID-19 infection 


Sampling: not stated 


Recruitment: both ret- 
rospective (n = 74) and 
prospective (n = 88) 


Two -group; 


Samples from symp- 
tomatic patients of all 
ages and gender 


Recruitment: not stat- 
ed; deliberate sampling 
to represent the TP rate 
at authors' institution 
(50%-60%), and to span 
low and high viral loads 


Laborato- 
ry-based (in- 
patient and 
ED); USA 


(April-May 
2020 ("4 
weeks data")) 


Laborato- 
ry-based (not 
stated; 3 labo- 
ratories); The 
Netherlands 


(Janu- 
ary-March 
2020) 


Laborato- 
ry-based (A&E, 
inpatient and 
outpatient); 
China 


(Not stated) 


Laborato- 
ry-based; USA 


(March-April 
2020) 


All sympto- 
matic 


Not stated 


Not stated 


Not stated 


Median age 
46 (IQR: 35 
(28-63); male 
= 69 (44%) 


"Sympto- 
matic"; no fur- 
ther details 


Not stated (all 
ages and gen- 
der) 


RT-PCR (single assay) 
Target: not stated 
NP in VTM (paired) 
Timing: not stated 


Interval: paired 


RT-PCR (multiple assays) 
Target: mixed 

As for index test 

Timing: as for index test 


Interval: same samples 
used; index text seems to 
have been conducted after 
frozen storage 

RT-PCR (single assay) 
Target: not stated 

deep throat saliva or lower 
respiratory tract; as per in- 
dex test 


Timing: not stated 


Interval: simultaneous 
(same samples) 


RT-PCR (single assay) 


Target: 2 regions of OR- 
Flab; either +ve 


single RT-PCR 
As for index; NP swabs 
Timing: not stated 


Interval: not stated in ex- 
act terms 


None reported (re- 
view team excluded 
21 samples with Xpert 
Xpress as reference 
standard) 


None reported 
Index: none reported 


Reference: none re- 
ported; no discrepant 
analysis 


None reported 


Index: samples +ve 
on only 1 target were 
both re-tested on RT- 
PCR only 


Reference: as above 


None reported 
Index: none reported 


Reference: none re- 
ported 


1 specimen with in- 
valid result on ID Now 
was excluded from 
that dataset 


Index: none reported; 
no re-testing conduct- 
ed 


Reference: none re- 
ported; no re-testing 
conducted 


A&E: Accident and Emergency [Department]; CDC: National Health Commission of the People's Republic of China; Ct: cycle thresh- 
old; ED: Emergency Department; FN: false negative; FP: false positive; HCW: healthcare worker; ICU: intensive care unit; IQR: in- 
terquartile range; N/A: not applicable; NOP: naso-oropharyngeal; NP: nasopharyngeal; NR: not reported; OP: oropharyngeal; PHE: 
Public Health England; RT-PCR: reverse transcription polymerase chain reaction; TN: true negative; TP: true positive; UTM: universal 
transport media; VTM: viral transport medium 
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Appendix 12. Molecular tests: summary index test details 


Study 


Assennato 2020 


Broder 2020 


Chen 2020a 


Collier 2020 


Cradic 2020(a) 


Index test (manu- 
facturer) 


SAMBA II SARS- 
CoV-2 Test (Diag- 
nostics for the Re- 
al World) 


GeneXpert Xpress 
SARS-CoV-2 as- 
say (no product 
code reported) 
(Cepheid) 


Xpert Xpress 
SARS-CoV-2 as- 
say (no product 
codes reported) 
(Cepheid, Sunny- 
vale, CA, USA) 


SAMBA II SARS- 
CoV-2 test (no 
product code re- 
ported) (Diagnos- 
tics for the Real 
World (DRW), Uni- 
versity of Cam- 
bridge, Cam- 
bridge) 


[A] ID NOW COV- 
ID-19 EUA; 

Study also evalu- 
ates [B] Diasorin 
Simplexa and [C] 
Roche cobas 6800 
SARS-CoV-2; not 
eligible for this re- 
view (Abbott Lab- 
oratories) 


Test method 
Target 


Automated RT- 
PCR 


ORF lab, N2 


Automated RT- 
PCR 


Not stated E 
gene 


Automated RT- 
PCR 


E and N2 gene 


Automated RT- 
PCR 


Orfl and the E 
genes 


Isothermal PCR 


RdRp 


Sample details 


Samples tested: combined nose and throat 
swab samples, provided as VTM 


Timing of sampling: not stated 
Timing of test: not stated 


Sample storage: not stated 


Samples tested: NP swabs (not specified) 
Timing of sampling: not stated 
Timing of test: within 3 days of RT-PCR 


Sample storage: not stated 


Samples tested: NP, saliva (posterior OP, self- 
collected by clearing the throat and spitting 

cl mL saliva directly into a sterile bottle in the 
early morning before mouth rinsing and break- 
fast) (VTM) 


Timing of sampling: not stated 
Timing of test: not stated; archived samples 


Sample storage: not stated; archived 


Samples tested: combined nasal/throat swab 
(NOP) on dry sterile swab. Collection not re- 
ported (direct) 


Timing of sampling: not stated; appears to be 
on presentation/admission but no further de- 
tails 


Timing of test: test performed within 18 h of 
reference test 


Sample storage: not stated 


Samples tested: NP swabs in UTM; collected 
on flocked swab, no other details, (VTM) 


Timing of sampling: unclear, infer upon pre- 
sentation 


Timing of test: immediate or within 72 h 


Sample storage: asap, or stored for up to 72h 
at 2 °C-8 °C. Following routine testing, samples 
were stored frozen (< -80°C) until comparator 
testing with the Roche cobas assay could be 
completed 


Test operator 
Test threshold 


Not stated; pre- 
sume laboratory 
staff 


Threshold: as per 
manufacturer; ei- 
ther target present 


Not stated; pre- 
sume lab staff 


Threshold: as per 
manufacturer 


Not stated; infer 
laboratory staff 


Threshold: not stat- 
ed 


Not stated; infer 
laboratory staff 


Threshold: as per 
manufacturer 


Not stated; infer 
laboratory staff. 


Threshold: as per 
manufacturer 
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(Continued) 


Cradic 2020(b) 


Dust 2020 


Ghofrani 2020 


Gibani 2020 


Goldenberger 
2020 


Harrington 2020 


[A] ID NOW COV- 
ID-19 EUA; 

Study also evalu- 
ates [B] Diasorin 
Simplexa and [C] 
Roche cobas 6800 
SARS-CoV-2; not 
eligible for this re- 
view (Abbott Lab- 
oratories) 


Xpert Xpress (no 
product code) 
[Also evaluates 
cobas SARS-CoV-2 
RT-PCR (Roche) 
and 3 in-house RT- 
PCR assays; not el- 
igible for this re- 
view] (Cepheid 
Inc) 


ID NOW COVID-19 
assay (no prod- 
uct code reported) 
(Abbott Laborato- 
ries) 


COVIDNudge (no 
product code) 
(DnaNudge, UK) 


Xpert Xpress (no 
product code) 
(Cepheid Inc) 


ID Now COVID-19 
assay (no product 


Isothermal PCR 


RdRp 


Automated RT- 
PCR 


E,N2 


Isothermal PCR 


RdRp region 


Automated RT- 
PCR; Described 
as "integrated 
lab-on-chip de- 
vice that enables 
sample-to-result 
(RT-)PCR" 


rdrp1, rdrp2, e- 


gene, n-gene, nl, 
n2, and n3 


Automated RT- 
PCR 


E,N2 


Automated RT- 
PCR 


Samples tested: NP swabs in UTM (collected 
as part of standard of care), plus direct testing 
of OP swabs and of nasal swabs (collected ac- 
cording to CDC instructions) (Direct) 


Timing of sampling: unclear, infer upon pre- 
sentation 


Timing of test: not stated; presume as for 
Cradic 2020(a) (immediate or within 72 h) 


Sample storage: not stated; presume as for 
Cradic 2020(a) (asap, or stored for up to 72 hat 
2°C-8 °C) 


Samples tested: NP swabs in VTM; collection 
not reported (VTM) 
Timing of sampling: not stated 


Timing of test: not stated 


Sample storage: not stated 


Samples tested: nasal 58 (51.3%), NP 33 
(29.2%), not stated 22 (19.5%) 

Direct testing 58 (51.3%), UTM 26 (23.0%); not 
stated 29 (25.7%). (direct or VTM) 


Timing of sampling: not stated; implies mostly 
close to presentation 


Timing of test: not stated 


Sample storage: not stated 


Samples tested: NP; HCW obtained swabs us- 
ing paediatric swab (Direct) 


Timing of sampling: on presentation; timing 
not reported 


Timing of test: not stated; appears to be as 
soon as possible after collection 


Sample storage: none described 


Samples tested: NP (VTM) 
Timing of sampling: not stated 
Timing of test: not stated 


Sample storage: frozen at —80 °C until batch- 
wise sample processing with the Xpert 


Samples tested: nasal swabs (provider collect- 
ed) (direct) 


Not stated; infer 
laboratory staff. 


Threshold: as per 
manufacturer 


Not stated 


Threshold: not stat- 
ed; presume as per 
manufacturer (pre- 
sumptive positives 

not mentioned) 


Not stated; infer 
laboratory staff 


Threshold: not stat- 
ed; presume as per 
manufacturer 


Unclear; possibly 
HCW 


Threshold: at least 
2 replicates of at 
least one viral gene 
target amplified 


Laboratory techni- 
cian 


Threshold: not stat- 
ed; both targets re- 
ported 


On-site medical 
personnel (urgent 
care centres); labo- 
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(Continued) 
code provided) Not stated Timing of sampling: not stated ratory personnel at 
(Abbott) each separate loca- 
Timing of test: not stated (soon after collec- tion (EDs) 
tion) Operators at 2 sites 
s — : were reportedly ex- 
AMIS Srelaee On perienced users of 
ID Now (one ED and 
1 urgent care cen- 
tre) and 3 sites re- 
ceived training) 
Threshold: as per 
manufacturer 
Hogan 2020 Accula SARS- Automated RT- Samples tested: NP swabs in VTM (n = 37) or Not stated; per- 
CoV-2 PocT (no PCR saline (n = 63, including 37 positive on RT-PCR) formed at the SHC 
product code re- (VTM or other) Clinical Virology 
ported) (Mesa N gene Laboratory 
Biotech, Inc., San Timing of sampling: not stated 
Diego, CA Threshold: as per 
fi ) Timing of test: not stated (? soon after collec- manufacturer 
tion) 
Sample storage: not stated 
Hou 2020 Xpert Xpress (no Automated RT- Samples tested: OP (not specified) Not stated 
product code re- PCR 
ported) (Cepheid Timing of sampling: not stated Threshold: not stat- 
Inc) E, N2 ed; presumably as 
Timing of test: not stated; frozen samples per manufacturer 
Sample storage: stored at -80 t within 24 h of 
collection 
Jin 2020 ID NOW (product Isothermal PCR Samples tested: dry swabs as per manufactur- Not stated; labora- 
code not report- er EUA protocol (direct) tory staff presumed 
ed) (Abbott Labo- RdRp 
ratories) Timing of sampling: not stated Threshold: as per 
manufacturer 
Timing of test: NR; appears immediate 
Sample storage: none 
Jokela 2020 Xpert Xpress (no Automated RT- Samples tested: NP or OP; no details on col- Not stated 
product code re- PCR lection (not specified) 
ported) (Cepheid Threshold: not stat- 
Inc) E,N2 Timing of sampling: not stated ed 
Timing of test: not stated 
Sample storage: not stated 
Lephart 2020 [A] [A] ID NOW [A] isothermal Samples tested: [A] nasal Not stated; pre- 
[B] Xpert Xpress PCR [B] NP sume lab staff 
Lephart 2020[B] (No product codes _[B] Automated Presume collected by HCW but not reported 
reported) RT-PCR (direct) Threshold: each as- 


([A] Abbott Molec- 
ular 
[B] Cepheid) 


2 additional RT- 
PCR tests evaluat- 


Not reported in 
paper 


Timing of sampling: on presentation; timing 
pso not reported 


Timing of test: [A] within 24h 
[B] stored at 4c and tested within 24h 


say was performed 
according to man- 
ufacturer’s EUA in- 
structions 
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(Continued) 


Lieberman 2020 


Loeffelholz 2020 


Mitchell 2020 


Moore 2020 


Moran 2020 


ed but not extract- 
ed 


[A] Xpert Xpress 
[A] Cepheid 


Also evaluates 4 
other assays not 
eligible for review 


[B] Panther Fusion 
RUO, Hologic 

[C] Panther Fusion 
EUA, Hologic 

[D] Simplexa, Dia- 
sorin 

[E] Cobas 6800, 
Roche 


Cepheid Xpert 
Xpress SARS- 
CoV-2 (RUO ver- 
sion, no product 
code reported) 
(Cepheid Europe) 


ID NOW COVID-19 
(product code not 
reported) (Abbott, 
Chicago, USA) 


ID NOW (no prod- 
uct code) (Abbott) 


Xpert Xpress 
SARS-CoV-2 assay 


Automated RT- 
PCR 


[A] E, N2 

([B] and [C] Or- 
flab, 2ab 

[D] S, ORFlab 
[E] ORFlab, E 


Automated RT- 
PCR 


Nucleocapsid 
gene (N2) and 
the envelope 
gene (E) (also 
detects RdRp 
but this does not 
contribute to 
positivity) 


Automated RT- 
PCR 


Not stated 


Automated RT- 
PCR 


RdRp 


Automated RT- 
PCR 


Sample storage: [A] appears to be room tem- 
perature 
[B] stored at 4 


Samples tested: NP swabs (collection not de- 
scribed) (VTM) 


Timing of sampling: not stated 
Timing of test: < 72h 


Sample storage: 4 ¢ with no freeze-thaws 


Samples tested: mixed [NP + saliva (NPS) (n= 
339), OP + saliva (OPS) (n= 15), combined NPS/ 
OPS in the same transport vial (n = 97)], and TA 
(n = 30): 

a. Baltimore - 61 NPS 

b. Los Angeles - 88 NPS 

c. Manchester - 54 NPS/OPS, 11 NPS 

d. Paris - 68 NPS 

e. New York City - NPS 11, OPS 15, TA 30, NPS/ 
OPS 43 

f. Milan - 79 NPS 

g. Newark - 21 NPS (VTM or other) 


Timing of sampling: not stated 


Timing of test: not stated; except one site <2h 
(n= 21) 


Sample storage: stored at -80 °C; except 1 site 
tested in real time (n = 21) 


Samples tested: NP in VTM 
Timing of sampling: not stated 
Timing of test: not stated 


Sample storage: stored at -80 T 


Samples tested: NP swabs in 3 mL VTM (col- 
lection not reported) (VTM) 


Timing of sampling: not stated 
Timing of test: < 72 h from collection 


Sample storage: none, or else stored at 4 °C 
(if testing could not be completed on the same 
day) 


Samples tested: 8 nasal and 95 NP swabs (not 
specified) 


Not stated; pre- 
sume lab staff 


Threshold: any one 
of two targets de- 
tected was consid- 
ered positive for all 
assays; Xpert Xpress 
data extracted as 
per IFU definition 
(positive = both tar- 
gets or N gene posi- 
tive) 


Not stated; pre- 
sume lab staff 


Threshold: as per 
manufacturer: if 
both targets are de- 
tected, or if only N2 
is detected, the test 
reports a positive 
result. If only the E 
target is detected 
the test reports a 
presumptive posi- 
tive result 


Certified laboratory 
personnel 


Threshold: as per 
manufacturer 


Not stated; pre- 
sume lab staff 


Threshold: as per 
manufacturer 


Not stated; pre- 
sume lab staff 
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(Continued) 


Rhoads 2020 


Smithgall 2020 
[A] 


Smithgall 2020 
[B] 


SoRelle 2020 


Stevens 2020 


Szymczak 2020 


Thwe 2020 


(no product code) 
(Cepheid, Sunny- 
vale, CA) 


[A] ID Now 

([A] Abbott; Chica- 
go, USA) 

(product codes 
not reported) 


Also evaluates 
Simplexa, Diasorin 
(Saluggia, Italy) 


[A] ID Now 

[B] Xpert Xpress 
(product codes 
not reported) ([A] 
Abbott 

[B] Cepheid) 


ID NOW (no prod- 
uct codes) (Abbott 
Diagnostics) 


Xpert Xpress (no 
product code) 
(Cepheid Inc) 


Xpert Xpress (no 
product code re- 
ported) (Cepheid 
Inc) 


ID NOW (no prod- 
uct code) (Abbott) 


E, N (N2 region) 


Automated RT- 
PCR 


Not stated 


Automated RT- 
PCR 


[A] RdRp gene 
[B] N2, E genes 


Isothermal PCR 


Not stated 


Automated RT- 
PCR 


E,N2 


Automated RT- 
PCR 


N2andE 


Isothermal PCR 


Not stated 


Timing of sampling: not stated 
Timing of test: not stated 


Sample storage: not stated 


Samples tested: nasal swabs (self-collected) 
and NP swabs (provider collected) (VTM or oth- 
er) 


Timing of sampling: not stated 

Timing of test: not stated 

Sample storage: not stated 

Samples tested: NP swabs (collection not de- 
scribed) (VTM or other) 

Timing of sampling: not stated 

Timing of test: within 48 h collection 


Sample storage: stored at 4°C 


Samples tested: saliva; collection not de- 
scribed (not specified) 


Timing of sampling: not stated; chart review 
of patients with FN results against either RT- 
PCR (NP) Xpert Xpress (saliva) (n = 9) showed 
6/9 tested > 2 weeks after symptom onset 


Timing of test: not stated 


Sample storage: not stated 


Samples tested: NP in VTM (VTM) 
Timing of sampling: not stated 
Timing of test: not stated 


Sample storage: Frozen at —80 °C 


Samples tested: stool, collection not reported 
(saline) 


Timing of sampling: PCR+ stool samples col- 
lected 0-33 days from initial respiratory PCR; 
8/27 collected at = 14 days and 6/27 collected 
at = 21 days 


Timing of test: up to 7 days 


Sample storage: stored at 2-8 T 


Samples tested: dry NP swabs (direct) 
Timing of sampling: not stated 


Timing of test: within 2h 


Threshold: as per 
manufacturer 


Not stated; pre- 
sume lab staff 


Threshold: as per 
manufacturer 


Not stated; pre- 
sume lab staff 


Threshold: as per 
manufacturer 


Not stated; pre- 
sume lab staff 


Threshold: as per 
manufacturer 


Not stated; pre- 
sume lab staff 


Threshold: pres- 
ence of N2+/-E 
gene; E gene on- 
ly considered pre- 
sumptive positive 


Not stated 


Threshold: not stat- 
ed 


Not stated 


Threshold: as per 
manufacturer 
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(Continued) 
Sample storage: appears to be room tempera- 
ture 
Wolters 2020 Cepheid Xpert Automated RT- Samples tested: NP or mid-turbinate, and OP 
Xpress SARS- PCR swabs (VTM or other) 


CoV-2 (product 
code not report- 
ed) (Cepheid Eu- 


E-gene (sarbe- 
co specific) and 


Timing of sampling: not stated 


Timing of test: not stated 


rope) N2-gene (SARS- 
CoV-2 specific) 
Sample storage: stored at -80 T 
Wong 2020 Xpert Xpress Automated RT- Samples tested: deep throat saliva (DTS) (n= 
(Cepheid Inc) PCR 120), or lower respiratory tract (LRT) (n = 42; 35 
sputum, 6 tracheal aspirate 1 BAL) (not speci- 
E and N2 fied) 
Timing of sampling: not stated 
Timing of test: transported on the same day 
and tested promptly 
Sample storage: not stated; transported to 
laboratory 
Zhen 2020 [A] [A] Xpert® Xpress Automated RT- Samples tested: NP swabs (VTM) 
SARS-CoV-2 PCR 
Zhen 2020 [B] [B] ID NOW COV- Timing of sampling: not stated 
ID-19 [A] N2,E we ; : 
(no product codes _ [B] RdRp Timing of test: for routine testing up to 72 h; 
20 samples tested prospectively after collec- 
reported) : 
tion on all systems 
A] Cephei 
Il Papier Sample storage: for routine testing (ePlex) 
[B] Abbott 


stored at 2-8 °C; then stored at -80 °C (ID Now, 
Xpert Xpress and Hologic RT-PCR); 

20 samples tested prospectively after collec- 
tion on all systems 


[Also evaluates [C] 
ePlex SARS-CoV-2 
Test, GenMark] 


Not stated; pre- 
sume lab staff 


Threshold: as per 
manufacturer: E- 
gene only positive 
specimens consid- 
ered ‘SARS-CoV-2 
presumptive pos- 
itive’ and require 
retesting, N2 only 
positives deemed 
positive 


Lab staff 


Threshold: as per 
manufacturer; pre- 
sumptive positives 
mentioned only in 
Introduction sec- 
tion 


Not stated; pre- 
sume lab staff 


Threshold: as per 
manufacturer 


BAL: bronchoalveolar lavage; ED: Emergency Department; FN: false negative; HCW: healthcare worker; NOP: naso-oropharyngeal; 
NP: nasopharyngeal; NR: not reported; OP: oropharyngeal; PCR: polymerase chain reaction; pso: post-symptom onset; RT-PCR: re- 


verse transcription polymerase chain reaction; TA: tracheal aspirate; VTM: viral transport medium 


Appendix 13. Index test details from manufacturer instructions for use documents 


Type of as- 
say 
Through- 
put 

Time to re- 
sult 


Equipment 
Kit storage 


Sample 
types 


Transport 
medium 


Index test@ Sample storage 


Test interpretation 
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Antigen tests 


AAZ; COV- 
ID-VIRO 
COVID-19 
Ag Rapid 
Test 


IFU: TR- 
COV-006 


Abbott 
Rapid Di- 
agnostics; 
PanbioTM 
COVID-19 
Ag Rapid 
Test Device 


IFU: 41FK10 


Becton 
Dickinson; 
BD Veritor™ 
System for 
Rapid De- 
tection of 
SARS-CoV-2 


IFU: 256082 


Beijing Sa- 
vant; SARS- 
Cov-2 Anti- 
gen Fluo- 
rescence 
Rapid De- 
tection Kit 


IFU: not ob- 
tained; no 
mention of 
any COV- 


CGIA 
Single test 


15min 


CGIA 
Single test 


15 min 


Not stated; 
LFA 


Single test 


15 min (up 
to 60 min if 
‘walk-away' 
mode en- 
abled) 


IFU not ob- 
tained 


Provides: test de- 
vice, buffer, NP 
swabs, extraction 
tubes, nozzles and 
filters; 


2-30 °C 


Provides: buffer, ex- 
traction tubes and 
caps, positive and 
negative control 
swabs, NP swabs 
for collection, tube 
rack 


2-30 °C 


Provides: test de- 
vice, extraction 
reagent, specimen 
sampling swabs, 
positive and nega- 
tive control swabs. 
Also requires: BD 
Veritor™ Plus An- 
alyzer (Cat. No. 
256066) 


2-30 °C 


IFU not obtained 


NP 


NP 


Nasal 


IFU not ob- 
tained 


Not stated 


Not men- 
tioned; im- 
plies not 
recom- 
mended 


Not recom- 
mended; 
"NOT IN- 
TENDED for 
testing liq- 
uid sam- 
ples such 
as wash or 
aspirate 
samples or 
swabs in 
transport 
media as 
results can 
be compro- 
mised by 
over dilu- 
tion" 


IFU not ob- 
tained 


Test ASAP after 
collection; can be 
stored in clean, 
unused sealed 
plastic tube at 
room temperature 
(15-30 °C) for up 
to 1h prior to test- 
ing. If > 1h delay 
occurs, dispose of 
sample 


Test direct swab 
specimens im- 
mediately after 
collection. If not 
possible, swab 
specimen can be 
kept in an extrac- 
tion tube filled 
with extraction 
buffer (300 uL) at 
room temperature 
(15-30 °C) for up to 
2h prior to testing 


Test ASAP after 
collection, and no 
later than 1h after 
specimen collec- 
tion 


IFU not obtained 


Visual: negative if control 
line only; positive if both 
test and control lines ap- 
pear no matter how faint; 
invalid if no control line vis- 
ible 


Visual: negative if control 
line only; positive if both 
test and control lines ap- 
pear no matter how faint; 
invalid if no control line vis- 
ible 


Automated: 'CoV2: +' indi- 
cates positive result; 'CoV2: 
-' for presumptive negative; 
‘CONTROL INVALID’ for in- 
valid result 


IFU not obtained 





Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 
Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 


Collaboration. 


388 


+4 Cochrane 
tw Library 


Trusted evidence. 
Informed decisions. 





Better health. Cochrane Database of Systematic Reviews 
(Continued) 
ID tests on 
website 
Bionote; Not stated; Provides: test de- NP Do not use Use the collected Visual: negative if control 
NOW- LFA vice, extraction transport specimenimmedi- _ line only; positive if both 
CHECK buffer tube and media ately. Specimens test and control lines ap- 
COVID-19 Single test nozzle cap, sterile may be stored at pear no matter how faint; 
Ag test ; swab, paper stand room temperature _ invalid if no control line vis- 
aad for up to Lhorat ible 
IFU: not 2-30 °C / 36-86 °F 2-8 °C/ 36-46 °F for 
stated up to 4h prior to 
testing 
Biosynex; CGIA Provides: test cas- NP Not stated Test ASAP after Visual: negative if control 
NowCheck settes, extraction collection; can be line only; positive if both 
COVID-19 Single test buffer, sterile swabs stored in clean, test and control lines ap- 
Ag test . (CE 0197), extrac- unused sealed pear no matter how faint; 
zavain tion tubes, end plastic tube at invalid if no control line vis- 
IFU: caps roomtemperature — ible 
SW4000605 (15-30 °C) for up 
2-30 °C to 1h prior to test- 
ing. If > 1h delay 
occurs, dispose of 
sample 
Coris Bio- CGIA (pa- Paper stripsina NPsorcul- Agelora ASAP, any delay Visual; read through collec- 
Concept; per strip bottle with desic- ture ex- spongema- mayresultinalow tion tube 
COVID-19 method) cant; LY-S dilution tracted trix can be signal intensity. If 
Ag Respi- buffer (3.5mLor15 solution; used not, store frozen Control line only (negative), 
Strip Single test mL; tubes and stop- samples at -20 °C T line (with or without con- 
; pers) must be liq- trol (positive), no control 
IFU:5723/. 15min uid line (invalid) 
TB/V03 4-30 °C 
e25bio; CGIA IFU not obtained IFUnotob- IFUnotob- —IFU not obtained IFU not obtained 
DART (Di- tained tained 
rect anti- 
gen rapid 
test) 
IFU: n/a 
Fujire- LFA (alka- Reaction cassette, NP fluid Not stat- Samples must be Visual; positive if blue test 
bio Inc; line phos- sample extraction ed; rec- prepared immedi- line (T) and reference line (r) 
ESPLINE phatase-la- solution (squeeze ommends ately after speci- positions, negative if blue r 
SARS-CoV-2 _ belled) tube), applicator tip samples men collection line only, invalid if no blue 
are pre- r line appears or if red r line 
IFU: Single test 1-30°C pared im- still present. If the rand T 
FRI46955 ; mediately lines appear before 30 min, 
(K4B01TE) = 30min after collec- the sample must be consid- 
tion (plac- ered "positive"; samples 
ing swab that only turn “positive” af- 
in provid- ter 30 min, must be consid- 
ed sample ered “negative” 
extraction 
solution), 
however 
document- 
ed clini- 
cal valida- 
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Innova CGIA 
Medical 
Group; In- 
nova SARS- 
CoV-2 Anti- 
gen Rapid 
Qualitative 
Test 


Single test 


20-30 min 


IFU: A/O2 
Liming CGIA 
Bio-Prod- 
ucts Co., 

Ltd; COV- 
ID-19 Anti- 
gen Rapid 
Test Device 
(StrongStep®) 


Single test 


15 min 


IFU: ob- 
tained via 
Weitzel 
2020 [A]; 
REF 500200 
vl 


Quidel; 
Sofia SARS 
Antigen FIA 


FIA 
Single test 
IFU: 15 min 


1439000EN00 
(04/20) 


RapiGEN 
Inc; BIO- 
CREDIT 
COVID-19 
Ag 


CGIA 
Single test 


5-8 min 


Provides: test car- 
tridge, extraction 
tube, extraction so- 
lution, QC card 


2-30 °C 


Test device, extrac- 
tion buffer vial, 
extraction tubes, 
workstation for 
holding tubes 


2-30 °C 


Provided: test 
cassette, reagent 
tubes, reagent solu- 
tion, nasal swabs, 
120 uL fixed volume 
pipette, SARS pos- 
itive control swab, 
negative control 
swab 

Required: Sofia or 
Sofia 2 reader de- 
vice, Calibration 
Cassette 


15 °C-30 °C 


Test device, assay 
diluent tube and fil- 
ter cap, swab for NP 
collection; 


1-40 °C 


tion results 
were from 
swabs im- 
mersed in 
VTM prior 
to use 


Not men- 
tioned 


Nasal or 
OP; intend- 
ed for use 
within the 
first 5 days 
of the onset 
of symp- 
toms 


NP or OP Not men- 
tioned in 


IFU 


NasalorNP Updated 
IFU: direct- 
ly test pa- 
tient speci- 
mens with- 


out trans- 


port media. 


Original 
IFU: if 
transport 
of samples 
with VTM is 
required, 
minimal di- 
lution of 
the sample 
is recom- 
mended, 
e.g.s1mL 
NP swab Not men- 
tioned in 
IFU 


Test ASAP after 
collection. Based 
on data generat- 
ed with influen- 
za virus, throat 
swabs are stable 
for up to 24h at 
room temperature 
or 2°-8 °C 


ASAP; can be held 
in clean, dry plas- 
tic tube or sleeve 
up to 72 h at 15-30 
°C, or 2-8 °C before 
processing 


Test ASAP after 
collection. Based 
on data generat- 
ed with influen- 
Za virus, nasal or 
NP swabs are sta- 
ble for up to 24h 
at room tempera- 
ture or 2-8 °C, and 
nasal or NP swabs 
in VTM are stable 
for up to 72 hat 
2-8 °C 


Test ASAP after 
collection; if stor- 
age required then 
2-8 °C for up to 12 
h, or -20 °C for up 
to 24h 


Visual: negative if control 
line only; positive if both 
test and control lines ap- 
pear no matter how faint; 
invalid if no control line vis- 
ible 


Visual; 2 coloured bands for 
positive; control band only 
for negative; test line only is 
invalid 


The Sofia screen will display 
results for the procedur- 

al control as being 'tick' or 
‘cross’, and will individually 
provide a't' or'-' result for 
SARS. If the procedural con- 
trol is 'X' retest with a new 
patient sample and a new 
test cassette. Results must 
not be interpreted past 30 
minutes after inoculation 


Visual; control line only 
(negative), control and test 
lines (positive), no control 
line (invalid) 
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(Continued) 
IFU: I- 
H0734- 
E00(2020.04.03) 


SD Biosen- —_ LFA (conju- 
sor Inc; gated with 
StandardQ colour par- 
COVID-19 ticles) 
Ag 

Single test 
IFU: Q- 
NCOV-01G 30min 


SD Biosen- FIA 
sor Inc; 


StandardF _ Single test 
COVID-19 4) 

Ag FIA min 
IFU: F- 

NCOV-01G 


Shenzhen FIA 
Bioeasy 
Biotechnol- 
ogy Co, Ltd; 
BIOEASY 
2019-nCoV 
Ag Fluo- 
rescence 
Rapid Test 
Kit (Time- 
Resolved 
Fluores- 
cence) 


Single test 


10 min 


IFU: TS-IU- 
F027-A2 
(YRLF04401025/ 
YRLF04401050/ 
YRLF04401100) 


Rapid molecular tests@ 


Abbott Di- Isothermal 

agnostics nucleic acid 

Scarbor- amplifica- 

ough Inc;ID tion 

NOW COV- 

ID-19 1 cartridge 
per run 

IFU: 

IN190000 5-13 min 

vl 


Provides: test de- NP 
vice, extraction 

buffer tube, filter 

cap, sterile swab; 


room temperature, 
2-30 °C/36-86 °F 


Provides: test de- NP 
vice, extraction 

buffer tube, filter 

cap, sterile swab. 
Standard F Analyzer 

also required (F100 

or F200) 


room temperature, 
2-30 °C /36-86 °F 


Test card, extrac- Nasal 

tion solution, ex- swabs, 
traction tube, drip- —_— throat 
per, swab and ID swabs and 
chip. Test runs on deep spu- 
immunofluores- tum sam- 
cence analyser ples 
(supplied separate- 

ly), transfer pipette 

also required 

Sample receiver Throat, 
(with elution/ly- nasal, NP 
sis buffer), test and OP 
base (with 2 sealed swabs (di- 
reaction tubes, rect testing 
each containing a or in listed 
lyophilised pellet), VTM) 


transfer cartridge 
for transfer of the 
eluted sample to 

the test base, pos- 
itive and negative 
control swabs; re- 


Not recom- 
mended; 
"Do not use 
transport 
media" 


Not recom- 
mended; 
"Do not use 
transport 
media" 


Not men- 
tioned in 
IFU 


Early ver- 
sions of IFU 
documents 
multiple 
options 

but now 
not recom- 
mended (ID 
NOW COV- 
ID-19 Prod- 
uct Insert, 
IN190000 
Rev.3 
2020/04:6-8) 


Test ASAP after 
collection; may 

be stored at room 
temperature for 
up to 1hor at 2-8 
°C/36-46 °F for up 
to 4h prior to test- 
ing 


Test ASAP after 
collection; may 
be stored at room 
temperature for 
up to 24h or at 
2-8 °C/36-46 °F for 
up to 48 h prior to 
testing 


ASAP after collec- 
tion, or store at 
2-8 °C for < 24h; 
or store at -70 °C 
for longer periods. 
Avoid repeated 
freezing and thaw- 
ing (no more than 
3 times). 


ASAP after col- 
lection, other- 
wise hold in orig- 
inal package at 
room tempera- 
ture (15-30 °C) for 
up to 2 h. If longer 
then store at 2-8 
°C for up to 24h 
from collection. 
No mention of 
frozen storage 


Visual; the presence of 'con- 
trol' and 'test' lines, no mat- 
ter how faint the result is 
considered positive; nega- 
tive if control line only; in- 
valid if test line only 


Automatic; the analyzer will 
automatically display the 
test result in 30 min. Cut-off 
index value = 1.0 is positive, 
< 1.0 is negative, cut-off in- 
dex not displayed is invalid 
result 


Automatic; positive if both 
detection line and control 
line detect a fluorescent sig- 
nal, and the detection line 
detection value is = 0.005 
ng/mL; negative if fluores- 
cent signal on control line 
only; invalid if no fluores- 
cent signal, or signal only 
on test line 


Automatic; results dis- 
played on the instrument 
screen as positive, negative 
or presence or absence of 
COVID-19 Viral RNAs cannot 
be determined 
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Cepheid 
Inc.; Xpert 
Xpress 
SARS-CoV-2 
test 


IFU: 
XPRSARS- 
COV2-10 


Diagnostics 
for the Real 
World Ltd; 
SAMBA II 
COVID-19 
Test 


IFU: REF 
8500-12 


dnanudge; 
Covid- 
Nudge 


IFU: 
9501001 
10-2020 (v 
4.1) 


Mesa 
Biotech 
Inc.; Accula 
SARS-Cov-2 
Test 


Automated 
RT-PCR 


1-80 car- 
tridges ac- 
cording to 
GeneEx- 
pert system 
used 


45 min 


Isothermal 
PCR 


Single test 
per run 


15h 


RT-PCR 


1.5h 


RT-PCR + 
LFA 


1 cartridge 
per run 


30 min 


quires ID NOW In- 
strument 


NP swab in 
VT™M 


Single-use dispos- 
able cartridges that 
hold the RT-PCR 
reagents and host 
the RT-PCR process, 
transfer pipette; run 
on GeneExpert Sys- 
tem 


Combined 
nose and 
throat 
swabs, NP/ 
OP swabs 


Each test set con- 
tains 4 cartridges 
for extraction, am- 
plification and de- 
tection of the am- 
plification prod- 
ucts, 2 mL SCoV 
buffer, fixed-vol- 
ume pipette, 300 
pL + pipette tips or 
transfer pipettes 
300 pL, sample col- 
lection tube and 
sample card; SAM- 
BA II Assay Module 
and Tablet module 
both required to 
run the test 


2-37 °C 


Includes: 
DnaNudge COVID 
Nudge Cartridge, 
NP sample kit, or 
sputum sample kit 
Requires: 
DnaNudge Nudge- 
Box, Oragene 
OG-500 sample col- 
lection tube (for 
sputum) 


NP or spu- 
tum 


<25°C 


Throat 
swab and 
nasal swab 
per test; di- 
rect testing 
only 


Each test kit con- 
tains: test cas- 
sette, SARS-CoV-2 
buffer (5.0 mL), sin- 
gle-use fixed-vol- 
ume pipette, posi- 
tive + negative con- 


Swab 
stored in 
viral trans- 
port tube 
containing 
3 mL trans- 
port medi- 
um 


Direct test- 
ing or UTM/ 
VTM can 

be used; 

no limita- 
tions on 
type of VTM 
recorded in 
IFU 


Not men- 
tioned 


Not recom- 
mended 
and will in- 
validate the 
test 


Store at room 
temperature (15- 
30°C) for up to 8h 
or refrigerate (2- 
8 °C) up to 7 days 
until testing per- 
formed 


Store at 2-30 °C for 
up to 18h prior to 
testing. 


Freezing of sam- 
ples should be 
avoided 


Swab should be 
immediately in- 
serted into the 
DnaCartridge and 
sealed. DnaCar- 
tridges containing 
swab specimens 
can be stored at 
room temperature 
(15-30 °C) for up 
to8h 


Prepared sample 
(in buffer vial) may 
be stored at room 
temperature for 
up to 24h or re- 
frigerated (2-8 °C) 
and tested within 


Automatic; displayed posi- 
tive (N2+ and E+, or N2+ on- 
ly), presumptive positive 
(E+ only), negative (both 
negative), no result (repeat 
test), instrument error 


Automatic; presented and 
stored on the connected 
tablet 

Tablet module result: nega- 
tive, positive, invalid, halt- 
ed, read failure or no results 
Visual reading of test strip: 
internal control line only 
(negative), = 1 of 2 test lines 
(ORF and or N lines) with or 
without internal control line 
(positive), no lines (invalid); 
other combinations possi- 
ble in rare cases 


Positive: if = 3 viral gene 
replicates amplify in any of 
the assays 

Indeterminate: if 1 or 2 of 
the viral gene replicates 
amplify in any of the assays 
Negative: if none of the as- 
says except the control as- 
say amplifies 

Invalid: if < 2 replicates of 
the control assay amplifies 
Error: in the event of any 
technical error during the 
sample preparation phase 
of the test, the NudgeBox 
will indicate with flashing 
red LEDs 


Visually interpretation 
(shown as blue test and 
control lines on exterior of 
test cassette): positive (any 
test line at T position, with 
or without control line C, 
but with no negative con- 
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IFU: trol swabs; Accula * check this 72hofsamplecol- trol line), negative (control 

LBL-60058 or Silaris dock re- - Hogan lection. line only with no negative 
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Figure 11 


Figure 11. Risk of bias and applicability concerns graph: review authors' judgements about each domain presented 
as percentages across included studies 
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Figure 12 


Figure 12. Risk of bias and applicability concerns graph: review authors' judgements about each domain presented 
as percentages across included studies 
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Figure 13. Risk of bias and applicability concerns summary: review authors' judgements about each domain for 
each included study 
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Figure 13. (Continued) 
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Figure 13. (Continued) 
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Figure 14. Forest plot of antigen test evaluations by study design. BR: Brazil; CH: Switzerland; DE: Germany; HCW: 
healthcare worker 
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Figure 15. Forest plot of studies evaluating antigen tests: higher versus lower viral load (< or > 25 Ct). BR: Brazil; CH: 


Switzerland; Ct: cycle threshold; DE: Germany; HCW: healthcare worker 
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Figure 15. (Continued) 


Figure 16 


Figure 16. Forest plot of studies evaluating antigen tests: higher versus lower viral load (< or > 32/33 Ct threshold). 
BR: Brazil; CH: Switzerland; ; Ct: cycle threshold; DE: Germany 


Antigen tests - Ct values < or <=32/33 





Study TP FP FN TN Symptom status Sensitivity (95% Cl} Specificity (95% Cl} Sensitivity (95% Cl)Specificity (95% Cl} 
Fourati 2020 [E] 180 0 65 @ Symptomatic 0.73 [0.67, 0,79] Not estimable + 
Gremmels 2020{a}) 101 0 5 oa Mixed 0,95 [0.89, 0,98] Not estimable + 
Gremmels 2020(b)} 48 0 1 #0 Not reported 0,98 [0,89, 1,00] Not estimable = 
Fourati 2020 [C] 161 O 84 O Symptomatic 0,66 [0.59, 0,72] Not estimable al 

FIND 2020b 104 0 12 =O Symptomatic 0,90 [0.83, 0,95] Not estimable all 
FIND 2020a 85 0 8 oO Symptomatic 0,91 [0.84, 0.96] Not estimable all 
Fourati 2020 [D] 174 Oo 70 O Symptomatic 0.71 [0.65, 0.77] Not estimable * 
Fourati 2020 [A] 103 0139 40 Symptomatic 0.43 [0,36, 0,49] Not estimable ll 

FIND 2020e (DE) 13. «0 8 0 Mixed 0,62 [0,38, 0,82] Not estimable —— 
FIND 2020e (BR} 80 0 17 © Symptomatic 0,82 [0.73, 0,89] Not estimable 7 
FIND 2020d (DE} 27 «0 9 0 Mainly symptomatic 0.75 [0.58, 0.88] Not estimable — 
FIND 2020d (BR} 89 0 21 O Mainly symptomatic 0.81 [0.72, 0.88] Not estimable + 
Fourati 2020 [B] 173 O 68 @ Symptomatic 0.72 [0.66, 0.77] Not estimable nal 
FIND 2020c (CH} 168 O 15 @ Symptomatic 0,92 [0.87, 0.95] Not estimable + 
FIND 2020c (BR} 91 0 8 0 Symptomatic 0,92 [0.85, 0.96] Not estimable ill 


0020406081 002040608 1 
Antigen tests - Ct values >32/33 


Study TP FP FN TN Symptom status Sensitivity (95% CI} Specificity (95% CI} Sensitivity (95% Cl}Specificity (95% CI} 
Fourati 2020 [E] 1 60 45 O Symptomatic 0,02 [0,00, 0,12] Not estimable = 

Gremmels 2020(a) o oO 33 =O Mixed 0,00 [0,00, 0.11] Not estimable = 

Gremmels 2020(b)} 3 8 11 9 Not reported 0,21 [0.05, 0.51] Not estimable — 

Fourati 2020 [C] 1 0 45 OQ Symptomatic 0,02 [0.00, 0.12) Not estimable = 

FIND 2020b 2 0 4 #96 Symptomatic 0.33 [0,04, 0.78] Not estimable — 
FIND 2020a 6 0 3 0 Symptomatic 0.67 [0,30, 0,93] Not estimable —— 
Fourati 2020 [D] 2 0 46 =O Symptomatic 0.04 [0,01, 0.14) Not estimable = 

Fourati 2020 [A] o 0 46 0 Symptomatic 0.00 [0,00, 0.08] Not estimable m& 

FIND 2020e (DE} o Oo 4 90 Mixed 0.00 [0,00, 0.60] Not estimable =&—————— 

FIND 2020e (BR} 7 O13 36 Symptomatic 0.35 [0,15, 0.59] Not estimable —— 

FIND 2020d (DE} Oo O 3 0 Mainly symptomatic 0.00 [0.00, 0.71] Not estimable §&——————— 
FIND 2020d (BR} 4 0 6 0 Mainly symptomatic 0.40 [0,12, 0.74] Not estimable —_—i 
Fourati 2020 [B] 2 0 44 =O Symptomatic 0.04 [0,01, 0.15] Not estimable = 

FIND 2020c (CH} 2 0 6 =O Symptomatic 0.25 [0,03, 0.65] Not estimable ——— 

FIND 2020c {BR} 3 0 4 =O Symptomatic 0.43 (0.10, 0,82] Not estimable 


Pt] H+ 
Oo20406081 0020406081 


Figure 17 





Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection (Review) 399 
Copyright © 2021 The Authors. Cochrane Database of Systematic Reviews published by John Wiley & Sons, Ltd. on behalf of The Cochrane 


Collaboration. 


E Cochrane Trusted evidence. 
= Lib Informed decisions. 
| iprary Better health. Cochrane Database of Systematic Reviews 


Figure 17. Forest plot of studies evaluating antigen tests: higher versus lower viral load (other Ct thresholds). Ct: 
cycle threshold; HCW: healthcare worker 
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Scohy 2020 24 0 10 O Mixed <30 0.71 [0.53, 0,85 Not estimable = 

Nash 2020 65 013 OO Not reported <30 0.83 [0.73, 0.91] Not estimable call 

Takeda 2020 48 0 2 0 Not reported <30 0.96 [0.86, 1.00 Not estimable al 

Diao 2020 55 0 1 0 Not reported <30 0,98 [0.90, 1.00 Not estimable a4 

PHE 2020(c) [non-HCW tested] 166 0 56 O Mainly symptomatic <28 0.75 [0.69, 0,80 Not estimable all 

PHE 2020(b) ll oo 1 0 Not reported <28 0.92 [0.62, 1,00 Not estimable — 

PHE 2020{a) 82 0 9 O Symptomatic <28 0.90 [0.82, 0.95 Not estimable + 

Liotti 2020 43 0 33 0 Not reported <35 0.57 [0.45, 0.68 Not estimable a. f ' 
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Antigen tests - other Ct thresholds for ‘lower’ viral load 
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Study FN TN Symptom status Ctthreshold Sensitivity {95% Cl} Specificity (95% Cl} Sensitivity (95% ClSpecificity (95% Cl} 








Fenollar 2020(b) 1 0 10 #90 Asymptomatic >=30 0,09 [0.00, 0,41] Not estimable —#—— 

Fenollar 2020(a) 7 O 22 90 Symptomatic >=30 0,24 [0.10, 0.44] Not estimable —s#— 

Alemany 2020 59 0 44 90 Mixed >=30 0.57 [0.47, 0.67] Not estimable + 

Van der Moeren 2020({b) 5 0 19 0 Symptomatic ==30 0.21 [0.07, 0.42] Not estimable —#— 

Veyrenche 2020 o o 15 90 Symptomatic >=35 0,00 [0.00, 0,22] Not estimable #— 

Scohy 2020 8 0 64 0 Mixed >=30 0.11 [0.05, 0,21] Not estimable - 

Nash 2020 15 0 7 0 Not reported >=30 0.68 [0.45, 0,86] Not estimable —— 

Takeda 2020 2 0 10 O Not reported >=30 0.17 [0.02, 0.48] Not estimable —#—— 

Diao 2020 86 0 66 O Not reported >=30 0.57 [0.48, 0.65] Not estimable ba a 

PHE 2020(b) 2 0 32 #0 Not reported >=28 0.06 [0.01, 0.20) Not estimable -— 

PHE 2020{a) 13,0 74 O Symptomatic >=28 0.15 [0,08, 0.24] Not estimable —# 

PHE 2020(c) [non-HCW tested) 48 0 102 0 Mainly symptomatic >=28 0.32 [0.25, 0,40] Not estimable -_ 

Liotti 2020 6 0 22 0 Not reported >=35 0,21 [0.08, 0.41] Not estimable =, 

5 0.2 ofa ote ots 7 5 of2 ofa o's ots 1 
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Appendix 16. Effect of sample re-testing and discrepant analysis 


Study 


Index test 


(target 
genes) 


Discrepant analysis 


Assennato 
2020 


Collier 
2020 


Harring- 
ton 2020 


Loeffel- 
holz 2020 


SAMBA II 
(ORFlab, 
N2) 


SAMBA II 


(ORFlab 
N2) 


ID NOW 
(RdRp) 


Xpert 
Xpress 
(RUO) (E, 
N2) 


First RT- 
PCR 


PHE Cam- 
bridge 
(Wuhan) 
assay 


In-house 
PHE assay 


Abbott Re- 


alTime 


Multiple 


RT-PCR as- 


says ac- 
cording to 
site 


Target 
gene 


RdRp, E 
gene 


Not stated 


Not stated 


Varied by 
assay 


Second 
RT-PCR 


PHE Col- 
indale RT- 
PCR assay 


Appears to 
be same 
assay 


Same RT- 
PCR 


Different 
RT-PCR 


Target 
gene 


RdRp 'dif- 
ferent re- 
gion’ 


Not stated 


Same 


Varied by 
assay 


False pos- False neg- 

itives atives 

330 151 

351 451 

230 47 no- 
retest 

1133 130 


Index test re- 
test 


Yes; 
same results 
obtained 


Yes; same re- 
sults obtained 


1FP reclassified 
as TN with re- 
peat sampling 
1 FP not re-test- 
ed 


None reported 


Reference standard re-test 


Yes 

3 FPs (reclassified as TP), all borderline 
positive for = 1 target gene on either RT- 
PCR test 

1 FN (remained FN), positive on both RT- 
PCR assays 


Yes 


2 FPs (recalsssified as TP) positive by 
PHE on retest and had high clinical sus- 
picion on notes review 


3 FNs (reclassified as TN) were negative 
by PHE on retest and were considered 
negative after clinical notes review and 
therefore were true negatives 


1 FP reclassified as TP 
1FP reclassified as TN 
(both with repeat sampling) 


1 FN re-classified as TN (inconclusive 
positive on Quest assay; negative on 
CDC assay) 

3 FP remained as FP (2 negative on NY 
assay, 1 negative on Charité Virologie as- 
say; all confirmed negative with Hologic 
Panther Fusion) 

8 FP re-classified as TP (all negative on 
Charité Virologie assay; positive on re- 
test with Roche Tib Molbiol assay) 
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(Continued) 


Moran 
2020 


Stevens 
2020 


Xpert 
Xpress (E, 
N2) 


Xpert 
Xpress (E, 
N2) 


Roche 
cobas 
6800 


Panther 
Fusion 
SARS- 
CoV-2 As- 
say (Ho- 
logic, Inc., 
San Diego, 
CA) 


ORF1, E 


ORFlab 


Same RT- Same 
PCR 
Same RT- Same 
PCR 


Additional studies reporting sample re-testing (not discrepant analysis) 


Broder 
2020 


Hogan 
2020 


Lieberman 
2020 


Moore 
2020 


Xpert 
Xpress (E, 
N2) 


Accula (N) 


Xpert 
Xpress (E, 
N2) 


ID NOW 
(RdRp) 


Roche 
cobas 
6800 


In-house 
assay 


CDC EUA- 
based in- 
house test 
(positive if 
1 of 2 tar- 
gets de- 
tected) 


Modified 
CDC RT- 
PCR 


ORF 1a, E 


E gene 


NI, N2 


N1, N2 


modified NR 


CDC pro- 

tocol 

N/A N/A 
N/A N/A 
Abbott Re- N, RdRp 
alTime 


130 


030 


130 


16 


25> 31 


1 FP reclassi- 
fied as TN (was 
initially E gene 
negative and 
low positive for 
N2; negative for 
both targets on 
re-test) 


No 


None reported 
No presumptive 
positive results 
reported 


Yes 

1TP remained 
as TP; faint pos- 
itive Accula test 
line was repeat- 
ed on re-test 


Yes 

1 presumptive 
positive (E-gene 
only positive) 
became posi- 
tive (N-gene on- 
ly positive) on 
re-test 


None reported 


1 FP 'repeatedly negative’ on RT-PCR re- 
test (re-classified as TN based on index 
re-test) 


1 FN (reclassified as TN) was negative on 
both targets for Xpert Xpress (FN), nega- 
tive on re-test with Panther Fusion 


Yes 
1 FN (became TN) 


None reported 


None reported 


All samples tested with both RT-PCR as- 
says 
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(Continued) 
Wolters Xpert In-house Varied by Same RT- Same 0>2 0 None reported 
2020 Xpress (E, assays per site PCR per 1 presumptive 
N2) site laboratory positive consid- 
ered TP by re- 
view team 


25 FN remained as FN (2 were inconclu- 
sive but considered positive on CDC as- 
say, confirmed positive with Abbott Re- 
alTime assay) 

6 TN reclassified as FN (negative on CDC 
assay, confirmed positive with Abbott 
RealTime assay) 

All 8 discordant results between the two 
RT-PCR's were confirmed SARS-CoV-2- 
positive based on record review 


2 TP samples (both positive on only one 
target; 1 presumptive positive (E pos- 
itive) and 1 positive (N2 positive)) re- 
classified as FP; both considered SARS- 
CoV-2 negative on RT-PCR re-test 
*authors note that viral loads were at 
the limit of detection for Xpert Xpress 
and that multiple freeze-thaw steps of 
samples could have had a significant im- 
pact on detection. 


CDC: center for disease control; EUA: emergency use authorisation; FN: false negative; FP: false positive; PHE: Public Health England; RT-PCR: reverse transcriptase poly- 


merase chain reaction; RUO: research use only; TN: true negative; TP: true positive 
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Appendix 17. Molecular tests - Additional figures for subgroup analyses 


Figure 18 


Figure 18. Forest plot of molecular test evaluations by study design 


Molecular test evaluations - Single group design 


Study TP FP FN TN Sensitivity (95% CI} Specificity (95% CI} Sensitivity (95% Cl}Specificity (95% CI} 
Thwe 2020 8B O 6 147 0.57 [0,29, 0,82] 1,00 [0.98, 1.00) —— Ld 
Jin 2020 4 0 2 46 0.67 [0,22, 0,96] 1,00 [0,92, 1.00] —— 4 
Hogan 2020 34 0 16 50 0,68 [0.53, 0.80] 1,00 [0,93, 1.00] —- 41 
Lephart 2020 [A] 1l oO 5 59 0.69 [0.41, 0.89] 1,00 [0.94, 1.00] —— +1 
Mitchell 2020 33°40413 #15 0,72 [0,57, 0,84] 1,00 [0.78, 1.00] — —1 
Harrington 2020 139 2 47 336 0.75 [0.68, 0.81] 0.99 [0,98, 1.00] * : 
Collier 2020 29 3 4113 0,88 [0,72, 0,97] 0,97 [0,93, 0,99] — a 
Cradic 2020{a} 30 0 3 151 0.91 [0.76, 0.98] 1,00 [0.98, 1.00] — g 
Cradic 2020(b} 12 oO 1 169 0,92 [0.64, 1.00] 1,00 [0,98, 1.00) — LJ 
Ghofrani 2020 16 #1 #1 = #5 0,94 [0,71, 1.00] 0,99 [0,94, 1.00] — a 
Gibani 2020 67 O 4 315 0.94 [0,86, 0.98] 1,00 [0.99, 1.00) + a 
Hou 2020 147 5S 6 127 0.96 [0,.92, 0,99] 0.96 [0.91, 0.99] a al 
Assennato 2020 8F 3 1 81 0.99 [0,94, 1.00) 0.96 [0,90, 0.99] a + 
Wong 2020 118 O 1 43 0,99 [0,95, 1,00] 1,00 [0,92, 1.00) a 4 
Lieberman 2020 13 0 0 13 1.00 [0.75, 1.00] 1,00 [0.75, 1.00] —1 —1 
Lephart 2020 [B] 16 2 0 56 1,00 [0,79, 1,00] 0,97 [0,88, 1.00] —1 4 
Moran 2020 42 1 0 60 1.00 [0,92, 1.00] 0.98 [0.91, 1.00] 4 4 
Jokela 2020 60 0 O 30 1,00 [0,94, 1.00] 1,00 [0,88, 1,00) } 7 —_— } —# 


Molecular test evaluations - Two group design 


0020406081 0020406081 


Study TP FP FN TN Sensitivity (95% CI} Specificity (95% Cl} Sensitivity (95% Cl)Specificity (95% CI} 
Smithgall 2020 [A] 65 0 23 25 0.74 [0,63, 0,83] 1.00 [0,86, 1.00] +a — 
Moore 2020 94 0 25 79 0.79 [0.71, 0.86] 1,00 [0.95, 1.00] a a 
Zhen 2020 [A] so 0 7 50 0.88 [0.76, 0.95] 1,00 [0,93, 1.00] + 4 
Zhen 2020 [B] 57 O 1 50 0.98 [0,91, 1.00] 1,00 [0.93, 1.00] 4 4 
Smithgall 2020 [B] 87 2 1 23 0.99 [0,94, 1.00] 0,92 [0,74, 0,99] a — 
Loeffelholz 2020 219 11 #1 250 1.00 [0.97, 1.00] 0.96 [0,93, 0.98] LI a 
Dust 2020 20 0 O 18 1,00 [0,83, 1.00] 1,00 [0,81, 1,00] — — 
Wolters 2020 58 GO GO 30 1,00 [0,94, 1,00] 1,00 [0.88, 1.00] 4 = 
Goldenberger 2020 10 0 @O 9 1.00 [0,.69, 1.00] 1,00 [0.66, 1.00) 


0020406081 002040608 1 
Molecular test evaluations - Unclear design 


Study TP FP FN TN Sensitivity (95% Cl} Specificity (95% CI} Sensitivity (95% Cl}Specificity (95% Cl} 
SoRelle 2020 32 0 7 44 0,82 [0,66, 0,92] 1,00 [0,92, 1,00] a 4 
Stevens 2020 53 0 1 50 0.98 [0,90, 1.00] 1.00 [0,93, 1.00] 
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Figure 19 
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Figure 19. Forest plot of studies evaluating rapid molecular tests: high versus low viral load (30 Ct threshold). Ct: 


cycle threshold 
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Figure 20. Forest plot of studies evaluating rapid molecular tests: high versus low viral load (other Ct thresholds). 
Ct: cycle threshold 


Molecular tests - other Ct thresholds for ‘higher’ viral load 
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Figure 21. Rapid molecular assays before and after discrepant analysis 
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Number of studies 


Test subgroups 

Sample type Overall 
Antigen tests n=48 
NP only 32 
Nasal 2 
Saliva 1 
NP+OP 5 

NP or OP or combined NP + OP or nasal (= 2 evalu- 7 
ated) 

BAL or throat wash 1 
Rapid molecular tests n=30 
NP only 14 
OP only 1 
Nasal 2 
Saliva 1 
NP+OP 2 


Direct testing 


19 


Using VTM 
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(Continued) 

NP or OP or NOP or nasal (= 2) 7 - - 7 
Throat saliva or LRT 1 - - 1 
Stool J) - - 1 
Not stated i} 1 - - 


BAL: bronchoalveolar lavage; LRT: lower respiratory tract; NP: nasopharyngeal; OP: oropharyngeal, VTM: viral transport medium 
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DIFFERENCES BETWEEN PROTOCOL AND REVIEW 


We planned to check the following websites for eligible index tests, however these did not prove to be very accessible or easy to use and, 
after initial review, were not further considered: 
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« National Institute for Health Research (NIHR) Innovation Observatory (www.io.nihr.ac.uk/) 
* www.rapidmicrobiology.com/test-method/testing-for-the-wuhan-coronavirus-a-k-a-covid-19-sars-cov-2-and-2019-ncov 





We planned to check the following evidence repository for additional eligible studies however, the EPPI-Centre and Norwegian Institute 
of Public Health resources proved to be more accessible therefore we decided to prioritise our other sources of evidence. 


e Meta-evidence (meta-evidence.co.uk/the-role-of-evidence-synthesis-in-covid19/) 


We intended for two authors to independently perform data extraction, however one review author extracted study characteristics, and a 
second author checked them. Contingency table data were extracted independently by two review authors as planned. 


We planned to evaluate the effect of additional sources of heterogeneity, including reference standard and sample type. However, 
additional formal investigations using meta-regression were not possible because of lack of variability across the studies in these features. 


We planned to conduct a sensitivity analysis excluding studies that are solely published as preprints. We have inadequate study numbers 
to allow this at present but will reconsider for the next update. 


INDEX TERMS 


Medical Subject Headings (MeSH) 


Antigens, Viral [analysis]; *Betacoronavirus; Clinical Laboratory Techniques [*methods]; Coronavirus Infections [*diagnosis] 
[epidemiology]; COVID-19; COVID-19 Testing; False Negative Reactions; False Positive Reactions; Pandemics; Pneumonia, Viral 
[*diagnosis] [epidemiology]; *Point-of-Care Systems; SARS-CoV-2; Sensitivity and Specificity 


MeSH check words 


Humans 
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